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ABSTRACT 

This report summarizes a strategy evaluation study of 
the Personnel Preparation Program (a division in the federal Ofxice 
of Special Mucation Programs) . The Personnel Preparation Program is 
intended to increase the numbers of qualified special educators 
through grants to institutions of higher education and state 
education agencies. This study specifically examined the federal 
strategy of targeting its resources to areas of critical de^nd for 
personnel, both current and projected. The study evaluated a model, 
HIRES, which uses the number of special education teachers hired to 
fill vacancies for the 1986-87 school year to determine current and 
projected national demand for special education teachers. Major 
conclusions include the following: HIRES as a single measure does not 
provide an accurate measure of demand; each of the HIRES comporent 
measures is associated with critical factors for estimating demand 
for special education personnel; of the HIRES measures, NO HIRES 
(number of budgeted unfilled positions) appears to be the best single 
measure of critical and current demand for special educators; and 
predicting demand for teachers beyond 3 years is of limited value. 
Seven major recommendations are presented. A set of separately bound 
appendices include the executive summary of a companion goal 
evaluation report, the data collection protocol, and a list of 
interviewees. (14 references) (DB) 
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PRSFACB ASD ACKllOULSOGBhWS 



This report describes the approach and results of an evaluation for the 
Personnel Preparation Program, one of five divisions in the Office of Special 
Education Programs (OSSP) in the U. S. Department of Education's Office of 
special Education and Rehabilitative Services (OSEHS) . This effort was a 
«fn«f..v evaluation , the second phase of a two-part proRram evaluation, con- 
ducted by a study team f nan the American Institutes for Research (AIR) . An 
earlier effort, conducted by AIR in the fall of 1986. was a «pal evaluation 
which examined the program logic and the extent to which the program was 
achieving its goals. 

The personnel Preparation Program is the third of five discretionary pro- 
grams being studied under an OSBP contract with COaiOS Corporation, with AIR 
participating as subcontractor. The COSI»S project director is Robert K. Yin; 
the AIR subcontract director is Peggie L. Caa^wau. Who also serves as task 
leader of the evaluation for the Personnel Preparation Program- 

Evaluations of other programs under this contract are for the Handicapped 
Children's Early Education Prciram. the Itedia Services/Technology Program, the 
severely Handicapped Program, and Secondary Education and Transitional Services. 
All five programs operate under the Education of the Handicapped Act. as amended. 

OSBP. through this contract, is utilising a program analysis approach to 
assist federal program managers. The approach takes program managers through 
a sequence of steps in Which they (1) clarify and agree on the performance 
objectives of their programs and on strategies for meeting th«B. (2) make 
explicit the assumptions that are implicit in their choices, and (3) evaluate 
and iavrove the plausibility and efficacy of these strategic choices. 

A particular strength of the approach is that it coiabines the expertise of 
program managers, a work groi«» of peers and staff, and an external evaluator (in 
this case. AIR), all of Whom go through descriptive and analytic processes 
together. The forum for their deliberations is a series of structured work 
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group meetings, held once every four to six weeks throughout the evaluation 
process . 



The work group a^ibers for the Personnel Preparation Program strategy 
evaluation are listed below. They helped to 8hq>e som of the study's products, 
and reviewed and critiqued others. Their knowledge of the Personnel Preparation 
Program snd its policy context, and the time they invested to make sure this 
collective effort stayed on track, were essential to the pertinence and utility 
of the strategy evaluation process. 



Work Group Henbers for the 
Personnel Preparation Program Strategy Evaluation 

Horm Horn 
Acting Director 

Division of Personnel Preparation 
Jack Tringo 

Related Personnel Branch 
Division of Personnel Preparation 

Louis Danietson 

Chief. Special studies Branch 

Division of Innovation and Development 

Bill wolf 

Acting Branch Chief/Project Officer 
Program Planning and Inforsiation Branch 
Division of Program Analysis and Planning 



In addition, Thomas Bellamy. Director of the office of Special Education 
Programs, took particular interest in this evaluation. His review of the 
original study design and his recommendations for refinements provided the 
study with a practical focus. 



While the authors alone are responsible for the final product, they would 
like to thank the work group and other individuals who were interviewed or 
provided documents and oth^r information to the study tesm. 

In particular, we wish to acknowledge the exceptional cooperation of key 
SBA and LBA personnel in the study saiiq>le. who participated in lengthy on-site 
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Interviwfs with the study team. Their names and their associations appear in 
Appendix C of this report. 

We also wish to acltnowledge Donald H. McLaughlin and Robert J. Rossi of 
AIR for their contributions in helping the study team to assess the prospects 
of making accurate long-term projections of personnel supply and demand in 
speeial education. 

The project was supported by funds ftjm the U. S. Department of Education 
under contract number 300-85-0143. The content of this report does not neces- 
sarily reflect the vieiis or policies of the U. 5. Department of Bducation, nor 
does mention of trade names, commercial products, or organizations ii^ly their 
endors«nent by the 0. S. Government. 
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Important »>tft 



This summary presents the highlights of a strategy evaluation for the 
Personnel Preparation Program; a related study, a goal evaluation, was 
conducted in the fall of 1986. Authorized under Part D of the Mucatlon of 
the Handicapped Act, the Personnel Preparation Program Is administered by the 
Division of Personnel Preparation (DPP) in the Office of Special Education 
Programs (OSEP), a part of the federal Office of Special Education and 
Rehabilitative Services (OSBRS), U. s. Department of Education. 



This evaluation examined one of several strategies the Personnel 
Prei^aratlon Program pursues to achieve the objective of increasing the numbers 
of qualified personnel to provide education and ralated services to children 
and youth who are handicapped. That strategy is tarnetinit its reewrces to 
areas of critical d^and for personnel — both currrot and p.-olected . The 
program implements this strategy primarily through the mmsS of grants to 
colleges and universities, which produce the personnel «rtM> are specially 
trained to provide the services. 



This study contrilwtes to the literature oa teacher supply and demand in 
special education. The reader is cautioned * however, ttet the study focused 
only on the droiand side of the teacher supply-and-doaand equatiim. And beyond 
that, the study focused only on one »)del for exMiining personnel dcound. 
That model is based on HIRES: the number of special education teachers hired 
by a local school district to fill vacancies (i.e., tnidgeted, unfilled 
positions) for the 1986-87 school year. 



OSBP defined the specific mission for the study team: to examine the 
utility of one model — a HIRES model — for determining tiM national demand (both 
current and projected) for special education teaclMrs. OSBP and the study 
team fully recognize that any cmi^lete examination of teacher «q>ply and 
d«sand imist Includa an ncamination of the supply side. OSSP and the study 
team also recognice that nuiMrous su>dels might be posed and examined for their 
utility in detenaining teacher siqpply and d«nand, including o»d»Is c'.ttslde tte 
supply-and-demand equation itself. 



Because d«nand is an Inherent part of the teacher supply-and-damand 
equation, the following summary begins with a stateomit of the more general 
problra of balancing the supply of trained teachers with the demand for their 
services. The statement provides the latter perspective within which this 
study of teacher dMiand must be viewed. 



BALANCIHG THE TEACHER SUPPLy-ASD-^DBIIAIID BQUATX(»i IB SPECIAL EDUCATIOM: 

A VIEW FROiS THE DSKAtH} SIDE 

Balancing the supply of trained teachers across the nation with the 
d^nand for their services is a cmi^lax problra. Ulmi the supply or d^oand 
changes t shortages or surpluses result. To avoid these shortages or surpluses, 
educators at national » regional, and state levels att«qpt to predict future 
changes of supply and d^&and so they can syst«satically plan for the training 
and hiring of teachers. Such projections, hmtever, require accurate and 
reliable data on the teaching profession » which at present do not appear to 
exist (Olson & Rodman, 1987). In addition, numerous factors Influence the 
supply and demand for teachers, each one presenting probl^iis that must be 
addressed* 

Predictina the Hational Supply and Demand for Teachers 

Having to predict the e^cpected suiwly of teachers in the united States at 
a future time raises iiimmdiate questions: 

e Hov many teachers will continue to teach fam one year to 
the next? 

e What is the age, experience, and subject area of teachers in 
the present pool? 

e What are the various sources of potential teacher supply? 

e How many graiduates of teacher-training prograais will 
actually rater teaching? 

a How many teachers who left teaching will decide to return? 

a What changes in the profession might attract irare people to 
the field? 

a Who can legitimately be cminted as a **teachar**? What 
criteria determine '^ccxnpetence to teach**? 




Anticipating the demand for teachers at a future time raises immediate 
questions as well: 

• How many teachers will leave their positions, and for what 
reasons will they leave? 

• What are the qualifications of individuals filling 
positions? Are they all fully qualified to teach, or iSo 
some lack the necessary requirements? 

• How many students who are handicapped will enroll from one 
year to the next? What individual needs for service will 
they have? 

• What are allowable teacher-pupil ratios in specific 
geographic and instructional settings? 

• In What districts and geographic regions will the open 
positions be? 

• What is the willingness and ability of districts to hire new 
personnel t 

• What are the resources and the extent to which districts can 
recruit for personnel? 

w What changes in the profession might cause more teachers to 
leave? 

When they review the data frtm school districts, which is filtered 
through state departjirants of education to th^, educational policymakers in 
Washington ask many questions about this data. They face the tfsk of 
predicting the nation's supply and demand for teachers, so they can direct 
their limited federal dollars at the areas facing critical shortages. 

t Do all school districts and do all states collect the aaasa 
kinds of infonnation on personnel? 

e If they collect the same kinds of information, does it mean 
the same thing? Do they follow a standard set of 
definitions for the categories of personnel data? 

e Do districts and states use similar data collection n^thods? 

e Hmt accurate and reliable are the data frc»a district to 
district and from state to state? 

e How does each district and each state differ in ways that 
affect the nature of their personnel data? What is the 
rai^e of these differences? 
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• Ar« fch«re any particular pieces of data fcm districts or 
states that night pinpoint the kinds of teachers that will 
be needed? 

These lists of questions ara by no laeans inclusive, Init they suggest para- 
meters for the kinds of information to be reviei«sd in assessing the magnitude 
and nature of the ever-changing supply and deinand for teachers in the nation. 

The Larner Context of Politics and Mcmey in toerica 

Education and, hence, projections of teacher supply and de«Band are ulti- 
mately shaped by the politics and econnoics of Amrica. The voting public and 
politiciuis place relative value on education according to the a^nint of money 
they are willing to spend on it. That value goes up or down depending on who 
is holding public office. Even if accurate and reliable data trere available 
to predict teacher supply and denand, the political and econcHnic forces shaping 
education respond to a variety of factors unrelated to either education or 
children, and lAiich are unpredictable. 

The Uniqueness of Speeiaj> Education 

Ccwipared with general education, nnasuring and predicting the supply and 
demand for teachers in special education in a national maiket is even more 
difficult (Settler & Settler, 1985). Figures for supply and demand depend on 
the specialization area of taaclmra within special education — learning 
disabilities, oaotional disturbance, multiple handicaps, tehavior disorders, 
developmental disabilities, and so on. And although the data on general 
education may not be conplete, accurate, and consistent, tim data on special 
education is even more sketchy. 

Until the 1970s, local school districts did not even begin to address the 
needs of many students for special education services. Federal mandates 
supporting the educational and civil rights of handicapped childrm and 
youth—the Education for All Handicapped Children Act (Public Law 94-142) and 
Section 504 of the Vocational Rahabilitation Act (Public Uw 93-112)— required 
school districts to address these needs. The federal and state funding that 
followed gave school districts increased ability to hire special education 
teachers co meet the new requireiMnts. 
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The Persfmnal Preparation Program; Tt» Faderal RoX» in 
Traininic tim Mat ion* a SuppIv of S t»cial Sducation Teachers 



The Personnel Preparation Program was authorised in 1970 under Pert D of 
the Education of the Handicapped Act (Public Law 91-230) for the purpose of 
"increasing the numbers of fully-qualified personnel that are available to 
provide education and related services to handicapped children and youth." 
The present program is the largest of the discretionary programs in the federal 
Office of Special Bdueation Programs (OSKP). Appropriations for the program, 
exceeding $60 million each year in FY85. FY86, and FYS?, support a large 
percentage of the new special education teachera being prepack nationally. 
The program uses its money to train teachers by awarding gcwts primarily to 
colleges and universities. Which train the teachers to provide the services. 

Because its money is limited, the Personnel Preparation Program oust 
direct it to training teachers in "areas of critical demand—both current and 
projected." In order to do this, it imist know what kinds of teachers are 
needed now and in the future. The program expects that its grants— available 
for the training of these needed kinds of teachers— will stimulate the colleges 
and universities to prepare more of thon. 

Grant applicants must present convincing evidence that the training they 
propose will address the areas of critical demand. Currantly, however, the 
federal program lacks a baseline against lAich to evaluate this evidence. 
Federal data and information requirements for states under PL 94-142 for a 
Comprehensive System for Personnel Development (CSPO) and for annual pupil- 
personnel counts of local districts have failed to yield data and information 
of sufficient quality and utility to provide the program with a guide for 
funding decisions. 

Increasingly, th9 Personnel Preparation Prognm is under pressure from 
the Office of Management and Budget (MB) to show that its training grants are 
producing fully-qualified personnel to msmt sl^rtages in local school dis- 
tricts. It faces the same obstacles that policymakers, professional organisa- 
tions, and researchers have all encountered in atten^ting to map the elusive 
terrain of teacher supply and demand. To date, no central, accurate, timely, 



and generally*acc9pted data systea Is available for tracking personnel supply 
and doaand in education — and in special education in particular. T}^ problen 
is confounded with sisnif leant infonntion gaps in the data that do exist, and 
with poorly articulated concepts and terminology. 

An Bxaainstion of the TsntetinK Strateiev; 

The Search for a Singl e Measure of Demand for Teachers 

OSBP requested the study team fnm the Arasrican Institutes for Research 
(AIR), subcontractor to a>WS Corporation on a larger study of five discre- 
tionary programs under the Education of the Handicapped Act, to focus on the 
targeting strategy of the Personnel Preparation Program. The overall purpose 
of this "strategy evaluation" was to assist the program to improve its strategy 
of targeting resources to areas of critical deoaand for personnel — both current 
and projected. 

OSBP asked the study team specifically to examine the utility of one 
measure for estimating demand for peraonnel. That measure was HIRES, meaning 
a count of the number of staff hired in a specified period, liore pc«icisely 
defined for the study, HIRES n^ant the number of special education teachers 
hired by a local school district to fill vacancies (i.e.. budKeted . unfilled 
p ositions) for the 1986-87 school year . 

To examine the utility of HIRES as a single measure of diiroand, ^ata were 
collected from ten local school districts — five from each of tw> states in the 
country. &qperts identified these states as having good data on special edu- 
cation personnel, and very well-informed staff who could provide insights on 
«ihat it takeai to toaild a good data syst^. The evaltMtion was a pilot effort, 
limited to two states — "the best" — and focused at the local level. It was 
limited to demand-side data and issues, while fully recognising the difficulty 
of s(q>arating perscmnel demand from supply. 

On-site interviem with special education administrators and personnel 
directors in tlw school districts provided information cm the local plaimins 
and hiring process. In additicm, interviewees provided planning documents, 
statistical reports, and summary data sheets, which «iere subsequently revie«rad. 
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Intarvim with staU-leval and regional-level administrators provided 
Information on the state context for local planning and hiring* 

The small sample size, and the considerable variations within it, 
permitted only limited statistical analysis of data from the san^le. 

The Findings of the Pilot Study 

HIRES as a sinKle measure does not Provide an accurat e measure of demand. 
It is made up of several measures, each of which imist be examined separately. 

Special education decisionmakers said ^he total number of teachers they 
hired (that is, the teaching positions they filled) for a year consisted of: 

e the number of positions they filled with underqualif led 
personnel (both those tiA)o had no certification at all and 
those who had inccMBPlete certif icgticm ) 

• the number of !^ positions they filled with fully-qualified 
personnel 

e the number of exiatinK positions they filled with 
fully-qualified personnel 

e the number of positions they filled with fully-qualified but 
less-than-qualitv personnel (that Is, those «rho had full 
certification but whose overall "coo^etence to teach" was 
questionable) 

Bach of the component measures of HIRBS is associated with factors that 
myat -r b« t^Ucsn Into account When estiaatins current and projected demand for 
personnel in special educatiov« on a national basis . 

Special education decisionmakers pointed out, for exaoqple, these ]^ 
factors which vmre associated, respectively, with each c«i^nent measure of 
HIRBS (listed above): 

e state certification requirements 

Tremendous variation exists in certification requirements 
across the states. For exaaqple, one state might have very 
stringent requirements for licensing its special education 
teachers and, therefore, have a resultant stortage of 
teachers in several areas. However, another state might 
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have less d«mandiins requlreiaents and, as a result, have an 
abundant supply of ''quallf led** personnel . 



• student enrol Ifflents c(»q>ared with state guidelines for 
BliniiMJBn/maxiBnHn teaeher-pupil ratios 

Guidelines for teacher-pupil ratios also vary greatly from 
state to state. For exaiaple, a state that alloifs a ratio of 
1 teacher for every 28 pupils WMild have less d«raand for 
personnel locally than a state that allows 1 teacher for 
every 10 pupils. 



e attrition/ turnover of teachers 

Teachers leaving existing positions account for nmst Job 
vacancies. Their specific reasons for leavins vary 
greatly. Bven if states made a concerted effort to collect 
attrition data, making national estimates of demand would 
involve predictions of human behavior, lAich aro difficult 
at best. 



e appropriatenesF of college training program; individual 
conqpetencies 

The quality of both training programs and individual 
teachers vetries greatly. 

Uhat if a school district trere unable to fill a vacant teaching pos>.cion 
for '4hich it had swney to si^port? Another coo^onent measure of HZRSS tras 
apparent: NO HIRES was the number of budR^t«l. unfilled positions in a school 
district tor a given year. This measure eradiated HIRES as a model for 
examining personnel d«nand. 

As a single measut^ within the HIRgS model. TO HIRBS se«BS to offer the 
"cleanest" measure of critical and current Cup to three years) demand for 
personnel in special education at the present time. 

Certainly, sf -ial education ctcisionmakers would agree on the definition 
of a "budgeted , unfilled position." They point out, however, that the under- 
lying reasons for 1R> HIRBS mist also be es^lored. Does the position rMiain 
vacant for a long time because of the geographic location or econmaic disincen- 
tives of the local school district? Does the individual district actively seek 
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qualified candidates, or is it passive in its recruitmont efforts? And **yT 
To be an appropriate target for federal program resources, the underlying 
reason must be possible to address through personnel preparation (i.e., 
training). 

To provide a more adequate estimate of current demand, HO HXK8S data 
should be supplemented with data on underqualified personnel. Local school 
districts consider that they have met their current demand for personnel gall 
When they have filled theii vacancies with fully-qualified teachers. Adding 
underqualified personnel to estimates of current demand requires further 
breakouts of data into: 

e numbers of positions filled with uncertified personnel 

e numbers of positions filled with not-fullv-certified 
personnel 

Predicting demand for teachers bevorid three years is of limited or no 
value at the state and local levels , according to the special education 
decisionmakers sanq^led in this study. It is at the national level that it 
becomes iflg>ortant, although the prospects for making accurate long-range 
(beyond five years) projections of demand for special edu'*ation personnel are 
dismal. 

Estimating demand for persoimel — current or future— also requires an 
accounting of factors that contribute to "unrevealed demand.** Such factors 
include state use of unduplicated ccMints of children, accounting only for 
their primary handicapping condition and not any secondary conditions they 
might have; state limitations on the number of children that can be identified 
within a particular handicapping category; the overall ability of a district 
to hire, based on the srount of state and federal funding it receives. 

What the Quantitative Dsta from the Study «r«TH '^^y*?'*** 

Based on extrapolation of figures in the Diaest of Bducation Statistics 
(1987), the study saiqple sppeared to \m representative of the nationwide 
teacher-pupil ratio (17.8) and ttM nationwide average percentage of pupils 
counted as requiring special education services (11.2%). The most striking 



o 

ERIC 



pattern was the difference betiteen the two states' special education teacher- 
pupil ratios. The difference does. In fact, reflect the official guidelines 
of each state for class size maxinuns. 

The quantitative data on each of the components of HIRES did not provide 
much information on the areas of current and critical demand for personnel 
across the ten districts in the study saaqple. Vi^^ing dooand in terms of the 
HIRES model (demand » numher of budgeted, unfilled positions 4 number of 
positions filled with underqualified personnel), the data revealed: 

e Two of the ten districts had budgeted, unfilled posit ions-- 
1 teacher of the trainable mentally handicapped 
1 teacher of the autistic 

e Three of the ten districts had positions filled with under- 
qualified personnel — 

1 uncertified teacher of the behaviorally and «notionally 
handicapped 

5 not-fully-certified teachers: 3 teachers of the 
emotionally disturbed and 2 teachers of the learning 
disabled 

1 not-fully-certified teacher r.f the onotionally disturbed 

Of the the total nuniber of HIRES (182) across the ten districts for the 
1986-87 school year, the currant demand for teachers was 9 (2 budgeted, 
unfilled positions 4 7 positions filled with underqualified personnel). The 
conclusion from these figures is that there is no major problem, and, 
therefore, no critical d^nand. However, the quantitative data alone is 
ir'sleading. Qualitative data from the local districts provided additional 
information on teacher demand that was essential for identifying shortages. 
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What the Qualitativft Data frtm the Study Sample Revealed 

AnecdQtal data obtained from local special education decisloraaakers 
provided additional and iog>ortant information for identifying shortages In the 
sanq>le districts: 

e Although districts were able to fill most of their positions, 
local decisioraoakers identified areas of ''shortage" as positions 
that were ^'hanl-to-f ill," and as personnel Vho were "difficult- 
to-find," requiring extensive recruiting. Typically, such 
shortages included: 

teachers of the anotionally disturbed . (Teacher turnover in 
this area is throe years on the average due to t\ w 
tr^Mndous draiands of the position.) 

teachers of speech and lanKuage . (Some districts consider 
speech and language to be a special education teacher 
position; 8<H&e consider it to be a relate services 
position. } 

occupational therapists and physical therapists . (Almost 
unanimously, the districts in the sample identified OTs and 
PTs as their most dif ficult-to-find personnel. These are 
related services positions, not special education teacher 
positions. ) 

e Because of the age of their special education teaching staff, 
several districts see sizable shorties ccmiing within the next 
three years, especially if early retironent bills ars passed by 
state legislatures. 

e Because of nwly-inc^-eased state certification requir^ients in 
the fflulti categorical program area, close to half the staff in 
several districts will become "underqualified** next year. 

Conclusions 

The HIRES model offers no single measure for estimating demand. tAwt the 
HIRSS model does offer is a logic&l, organizing frameworc for further examina- 
tion of personnel demand in special education. Interpreting national data on 
demand requires understanding the factors that influence both demand and 
supply. This study has provided a maar^s by which the federal program can 
carry out future research and data gatherif^^ on personnel danand. organized 
logically by the ecxnponents of demand and the factors that influence it. 
Because very little is lonown about personnel supply, another study (such as 
this pilot study of d«Band) will have to identify the coiaponents of supply and 
the factors that influence it. 
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Local school districts are very ablo to specify their currant and critical 
demand for personnel . Howver, federal data requirements from states and 
aggregated data do not provide a view of teacher draand with the clarity, 
accuracy, and timeliness of that in local districts. Because these federal 
requirements have not provided useful data for predicting teacher supply and 
deaiand in a national narket, they may be unjustified. Certainly, there is 
justification for seelcing a more efficient, economical, less burdensome 
alternative. This study also suggests that any quantitative data on teacher 
desund noist be suppleronted with qualitative data fetm local school districts 
where the demand originates. 

Targeting federal training resources on the basis of short-terra projec- 
tions is questionable. Data ages fast, and local district data is vbXI out of 
date by the time it reaches the federal level. Short-term projections also 
fall short of the lag time in the system: the federal funding cycle starts 
two years ahead of awards; and grantees* training programs take three to five 
years to produce trained personnel. The prospects for making accurate long- 
term projections of teacher supply and dmnand, hmever, do not look good. 
States acknowledge difficulties in using historical data for forecasting 
beyond three years. And, ultimately, the unpradictable nature of politics and 
funding — major forces in determining the market for special education 
teachers — make market projection perilous. Given this context, estimating 
nationwide d«nand can still be a»aningful, but only within the range of time 
that political forces are unlikely to have great effect. These projections, 
based on current measures of dmiand and derographic projections, can serve 
some of the imrposes of a strategy for targeting resources to areas of 
critic^il demand for pf^k-sonnel. 

Hi^ business of special education personnel is to provide services that 
meet the needs of children and youth who are handicapped. Counts of personnel, 
and the politics and funding that 8ha|>e demand, may obscure these needs. 
Finally, thi'* study can only raise the question: Is tlMre a viable way of 
basing estimatett of personnel denand on the needs of childrm and youth for 
special education and related services? 
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ReccKM»ndatl<mg 

The following recoaa^ndationfl were offered to the Personnel Preparation 
Program for la^rovlng Its strategy of targeting resources to areas of critical 
demand for personnel — both current and projected: 

1. Decide the components of demand that the federal oroaram can 
address and match data collection to this policy objective. 
Using a HIRES B»del, the study su^asted that current and 
critisal demand for personnel in local school districts was 
represented by budgeted, unfilled positions and the positions 
filled with underqualified personnel. At a minimum, then, 
the federal program can target its resources to meet this 
d^nand. 

(hiantitative data, homver, are insufficient for identifying 
personnel shortages. Qualitative data are also required to 
provide a more accurate description of the shorties, and to 
decide whether or not they can be addressed by training. 

Federal reporting requircoronts for states sh(mld be drastic- 
ally reduced or abandoned altogether if the data are not 
useful for targeting or other OSSP purposes. 

2. In the absence of useful data for predictina te acher buppIy 
and demand in a national marlcet. use inexpensive methods that 
obtain a "Quick fix" on areas of cutrent and critical demand. 
Staall-scale surveys of a rapresentative sao^le of local 
school districts, high-producing institutions of higher 
education, and states with good data and data systems might 
yield a profile of local, regional, and national demand for 
personnel as good as one provided by a more costly, large- 
scale, definitive study. 

3. Plan data collection in collaboration with SBAs. tJAs. iHBs. 
and major professiona l oraanigations. Bach group plays an 
Isqportant role in balancing the teacher supply-and-draisnd 
equation A data collection effort that serves the purposes 
of ifl^ortant interests will be more efficient. 

4. Conduct feas ibility studies of statistical means for 
imnrovina the utility of available data. 

5. Aaree on def initions of terms that the federal aovemment 
uses in state iMnts about taraetina critical areas of d«a«nd 
for personnel . Consistent use of a standard set of 
definitions for terms commonly used in t elation to peraonnel 
supply and demand would facilitate imdarstandii^ of data 
collection forms, grant announcements , internal planning 
docuii»nts, program regulations, and public statements. 
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6. yark doaal v with ttm national ClwlnKhouia on Cmmva and 
Rgmlovamt ir sp tial E^catiim. and ammort nmi studiaa 
CWtWtt aM)ropr iaf.al to «yfipf|^^teallir builiy a eMmr«h«i«iv 
databaaa that la uaaful for tarKatinff r?r 'BfPyff! f?T 
oaraoiMial . TTiia study providad an orsaaising frauMMork for 
•xttdnins paramwal d«»nd in spaeial aducation. Tha 

f ramawork can tm uaad to coerdinata furthar a^y by OSBP/Di>P 
and tha Claaringhouaa. A fomal agraaoiant of tha vorUns 
relationship sight astsblish tha federal progrm as an 
ioportant client, one who stands to Imiafit frc« the database 
and expertise the Clearinghouse will develop. 

7. seek a viab le and acceptable way to base astlmatas of 
personnel deaand on the naeda of children and vwith for 
special educ ation and related services. Ideally, tha needs 
of childran and ymith for special education services should 
define the donand for personnel. 

The full report of the strategy evaluation discusses each of these recom- 
mendations in detail. The first five reconmendations are for Inanediate io^le- 
mentation; the last two are for inplementstion over the longer term. 
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I. Background 



Targeting areas of critical deaand for personnel — both current and pro- 
jected — is one of several strategies the Personnel Preparatica Prograa pursues 
to increase the nunbers of specially trained persons nho are qualified to 
provide education and related services to children and youth who are handi- 
capped. OSEP ffianagenent and staff singled out this particular strategy for 
further study in the second phase of a two-part progran evaluation, rie 
initial phase, which was called a "goal evaluation," docunented the federal 
program's goals and logic, and exaiained the extent to which specific strate- 
gies were being ioplesented through grant activities in the field and through 
prograa adolnistration at the federal level— and with what results (Canpeau, 
Appleby, and Stoddart, 1987).* 

Although the conclusions of the goal evaluation were generally positive 
about the likelihood of achieving loeasurable progress toward federal program 
objectives with current strategies, reccramendations in the final report 
(o£. clt.) pointed out respects in which particular strategies should be 
re-evaluated or re-defined, noted the need for evaluative data to fill infor- 
mation gaps, and called attention to unresolved prograaaatic issues. The 
concluding chapter of the final report suggested a number of candidate topics 
for further study, each pertaining to one of the strategies the federal 
program is currently using. 

The OSEP Director and meabers of the review group considered these 
suggestions at a briefing on findings froa the goal evaluation. They 
expressed a strong preference for the second phase of the study, called a 
"strategy evaluation," to develop information the federal prograa could use 
to improve its strategy of targeting critical demand for personnel. 



* Appendix A contains the Executive Summary for the goal evaluation of the 
Personnel Preparation Program* 



What the Coal Evsluatlon Concluded about the Federal Program's 
Strategy for Targeting Critical Deaand for Personnel 

The Personnel Preparation Program expects that directing program resources 
to training in areas of critical demand for personnel (both current and pro- 
jected) will stimulate the field to prepare more of these types of personnel. 
The federal program's targeting strategy Includes these elements: (1) setting 
priorities, (2) announcing priorities and selection criteria annually for 
funding competition, and (3) reviewing and awarding grants. 

Nearly all grantees are institutions of higher education (IHEs) and state 
educational agencies (SEAs), but mostly IHEs —the supply side of the program— 
the producers of personnel with the specialized training required to provide 
special education and related services to children and youth who are 
handicapped. 

Grant applicants must present convincing documentation to demonstrate the 
objectives, focus, and substance of the activities they propose to implement 
if their application is selected for funding. As motivation to do this, the 
evaluation criteria allot 25 points ^out of 100 possible In FY 1986) to the 
applicant's "statement of needs." 

The 56 grantees in the sample for the goal evi;luatlon used data from a 
vide variety of sources to make a strong case for their proposed focus. The 
fit was very close between the areas of need they d(K:umented and the prograos 
and models they developed, or the training they delivered. 

However, the goal evaluation concluded that while the targeting strategy 
was well-articulated and orchestrated by the federal program and Implemented 
in good faith by grantees. It was not responsive to mounting pressures— 
especially from the Office of Management and Budget (OMB) — to demonstrate that 
its training grants were producing personnel to meet the demand (i.e., short- 
ages that local school districts are experiencing in the supply of qualified 
personnel) . 

Specifically, the federal strategy for targeting critical areas of demand 
for personnel lacks a satisfactorily functioning system or mechanism to provide 
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A baseline against which to evaluate the supply side's documentation of such 
areas of denand in their initial and continuation applications. Requiresents 
of states under PL 94-142 for CoBprehensive Systems for Personnel Development 
(CSPD) and for annual pupil-personnel counts have failed to yield data and 
infortoation vboee quality and utility are sufficient to provide the Personnel 
Preparation Program irith a demand-side profile to guide funding decisions. 
Grantees (representing a supply-side perspective) say that CSPD information 
and states' axmual counts are least useful for documenting needs for highly 
specific personnel specialties* and for projects serving regional and national 
interests or needs (such as those submitted under the Leadership competition). 
Federal program staff agree with this observation* 

COTiplexity of the Problem 

Policymakers, program constituents (professional organizations and 
grantees), and researchers have all encountered obstacles In attempting to map 
the elusive terrain of personnel supply and demand* To am up broadly: 

• The intransigent problem of i^t constitutes critical per- 
sonnel demand and how to amasure it precludes the ability to 
focus resources on satisfying it* 

• There is no central, accurate, timely, and generally 
accepted data system for tracking current and projected 
manpower supply and demand in education — and in special 
education in particular. Nor is there a generally accepted 
analytic model that specifies data requirements for such a 
system. 

• Politics and money have an inordinately large effect on 
state and local estimates of demand for personnel. 

• These and other "market forces" have been ignored in past 
studies of teacher supply and demand. 

There are two sides to consider in the market for special education 
personnels the supply side and the demand side. On the supply side are 
personnel preparation providers, such as institutions cf higher education, and 
the internal and external factors that influence their capacity to produce 
qualified personnel. On the demand side are consumers, such as local educa- 
tion agencies (LEAs), and the internal and external factors that affect their 
acquisition of personnel. The anticipated demand for particular kinds of 
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special education personnel, and the expected supply of those who will be 
available to fill th-xt debaad, are the basis for projecting shortages (or 
surpluses) of personnel. 

In a freely functioning econMslc market, price fluctuation Is the oechan- 
Ism for maintaining parity betiraten supply and demand. De^nd for goods or 
services In short supply drives prices up and thereby attracts new suppliers. 
Prices fall when supply exceeds desund, and suppliers leave the luirket. In 
the market for educational personnel, however, there is question as to whether 
this economic theory of equilibrium holds. Some analysts say the institutional 
rigidity of education permits little, if any, flexibility of salaries in 
response to changes in supply and demand (Sattler & Sattler, 1985), or that it 
is unlikely teacher salaries will ever Increase by the estimated 40X necessary 
to make teaching economically competitive with careers that attract ''reasonably 
bright college graduates" (Hawley, 1986). Rather than provide additional fisads 
to LEAs to finance salary supplements to special educators who are in criti- 
cally short supply, states maj instead redefine handicapping conditions (i.e., 
make definitions more restrictive to exclude certain children vho would other- 
wise be eligible for special education services under broader definitions) 
and/or relax requirements for certification and the policies for employing 
underquallfied personnel (McLaughlin, Smith-Davis, & Burke, 1986; Schofer & 
Davis, 1986; and Smith-Davis, Burke, & Noel, 1983). Other analysts perceive 
that the market does seek and find equilibrium, and does so through the normal 
market mechanisms (Darling-Hammond, 1987; Olson & Rodman, 1987; Roth, 1986; 
and Yates, 1987). 

The implication for model builders is that they must allow for various 
"market adjustment mechanisira'' to work in analyzing supply and demand, includ- 
ing the incentives and disincentives of teaching that affect the individual's 
decision to teach. 

Further complicating the rroblem are poorly articulated concepts and 
terminology and significant Information gaps in the data that underlie dls- 
agreeTCnts over the magnitude and character of personnel supply and demand in 
education. For example, analysts point out that reliable and useful data are 
seriously Inadequate or unavailable on attrition, turnover, classrooms staffed 
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by personnel wbo are less-than-fully qualified, Boveoent within the systea 
(where newly-hired teachers come from, where teachers go who leave the district 
but continue to teach), and so on. 

Determining these paraaeters and complexities of the larger problem 
provided the sseans for focusing the strategy evaluation on a piece of the 
problem. 

Setting the Boundaries for the StrateRV Evaluation 

VI th others working on plrces of the problem, some from the model 
development end, others from the data end, what useful information for 
policymaking could the strategy evaluation provide with its modest budget and 
before the end of FY 1987? Should and could it focus on the supply side, the 
demand side, or both sides of the market for special education personnel? 

After deliberation, the work group and the study team proposed to address 
these questions in the strategy evaluation: 

• What kind of Information is presently available that may be 
potentially useful for establlshlns whether or not shortages 
exist? 

• How accurate and reliable are these data? 

• What diff Ict'ltles might be encountered if such data were 
required frr a national (central) data system? 

• How might these difficulties be addressed? 

The work group also agreed that the strategy evaluation would be a pilot 
effort in a couple of states reputed to have exceptionally good data for spe- 
cial education personnel, and exceptionally competent staff vho could provide 
knowledge and Insight on what It takes to build a good data system. Given the 
limited resources available for the pilot study and the complexity of the 
larger problem (disc issed above), the work group agreed that the emphasis of 
the study would be on personnel demand— the side of the supply-and-demand 
equation that the program knew least about. 
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The study teas and representatives of the work group met with the Director 
of the Office of Special Education Programs COSEP) and mefflbers of the OSEP 
review group to brief them on plans for the strategy evaluation. OSEP sug- 
gested that the focus be narrowed from "whatever data are available" to one 
potential estimate of personnel demand — and that this be "HIRES, " Generally, 
for this study "HIRES" means a count of the number of relevant staff hired in 
a specified period. 

OSEP*B preference reflected a shift to nusbers that were not soft, and 
that were easy to count with accuracy and reliability. What light could the 
strategy evaluation shed on the potential utility of such a oeasure as "HIRES" 
for establishing current and projected dem«id for personnel? The next chapter 
describes the resulting design for the strategy evaluation. 

Definitions of Terms for this Report 

Taking seriously the criticism that unclear and inconsistent use of terms 
contributes to problems of discussing and assessing the complexities of per- 
sonnel demand (and supply), the pilot study established the following working 
definitions: 

• Demand for personnel is synonymous with the "need to hire." 
It is used in the sense of "supply and demand" from the 
field of labor economics. 

* ^^^^ refers to the requirements of children and youth for 
special education and related services. 

This report differentiates between "need" for services (by 
those 1^0 are handicapped) and "demand" for teachers (the 
"need to hire" personnel). 
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Purpose, Scope, and Rationale for the Study 

The preceding chapter cloaed by describing the partnership of the study 
teas, the work group, and OSEP oanagenent in setting the boundaries for evalu- 
ating one strategy of the Personnel Preparation Program: targeting current 
and projected deaand for personnel. They agreed to the following overall 
approach. 

• The strategy evaluation would be a pilot effort in two 
states, and would focus at the local level. 

• While recognizing the difficulty of separating personnel 
demand from supply, all partners agreed to limit the pilot 
study to data and Issues of demand . 

• A specific focus would be to assess the potential utility of 
data on HIRE for developing current and projected estimates 
of demand for persoimel. 

Conceptually, the study's purpose would require improving the construct 
validity of HIRES and articulating its cwirplexlties. For example, it would be 
important to identify and define factors that might need to be known and 
accounted for in a model of personnel demand in which HIRES was the single 
oeasure of demand* 

In addition, potent bureaucratic and contextual conditions that might be 
hard to quantify could confound HIRES as a valid and reliable measure of 
demand. For example, undesirable geographic locations or stringent state 
certification requirements in particular specialty areas might make it more 
difficult for a local district to recruit personnel to hire. 

Finally, if there were better proxies for personnel demand than HIRES, 
the strategy evaluation would have to be alert to these candidates. 

Practically, information on HIRES, and the variables Ukely to influence 
it, wt Id have to be available through channels that federal-level pollcyaakers 
could access. And it would have to be available in a form that was economical 
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to retrieve, aggregate, and analyse. Thus, the strategy evaluation would have 
to detenalne reporting routines for each variable, and estimate the accuracy, 
reliability, and cost of obtaining this Inforsatlon. 

Evaluation Questions that the Pilot Study Addressed 

To accoapllsh the above purposes, the strategy evaluation addressed these 
qu*>stlons: 

1. Is HIRFS an accurate estimate of the demand for personnel? If 
not, i^t otiier variables and conditions are associated with 
hiring that might need to be specified and controlled for? 

2. What quantitative data are available, back several years, on 
HIRK and related variables? 

3. Are these data accurate and reliable? 

4. What reflnf*ments do the data suggest for measuring personnel 
demand? 

5. What are reporting routines and costs for various data 
cm&ponents ? 

6. What difficulties are likely to be encountered if auch data 
were required to Implement a federal strategy for targeting 
critical demand for personnel? How might these difficulties 
be addressed? 

Selection and Nature of the ^itudy Sample 

The sample for the strategy evaluation consisted of two state education 
agencies, two intermediate (or regional) education agencies, and a total of 
ten local education agencies — five from each state. This sample represented 
the demand side of the personnel supply-and^emand equation, although the SEAs 
also had linkages with the supply side, especially with state-supported 
colleges and universities that train special education personnel. 

Criteria and asauBg>tlons that guided sample selection . Only those states 
that certify or endorse in specialty areas (i.e., categorical states) were 
considered. Thus, a first assumption was that targeting critical demand for 
personnel requires data that are brokeia jut by category of personnel and /or 
specialty area. 
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A second assufflptlon vas that addressing the evaluation questions votild 
require access to good date and to people with expertise and practical 
insights on iihat It takes to build an adequate data ay stem, A safe assusptlon 
was thac good data and ?oci staff go together. Therefore, a second selection 
criterion was fue known quality of data and data systems in the candidate 
state. 

Procedures for selecting SEAs i:or th«g study sample . The study director 
obtained SEA nominations from two consultants nho had recently reviewed the 
status of SEAs* special education personnel data systems.* Each consultant 
independently noolnated four or five states that met the above criteria, and 
identified an SEA contact. The study teas called each candidate SEA to obtain 
information about features of their data systems that were especially relevant 
for the pilot study. For example, did the SEA have data on budgeted, unfilled 
positions by category or specialty area, and could the data be disaggregated 
to the LEA level? Did the SEA have data back several years that could be 
compared with current data? What did the SEA do to help LEAs fill budgeted 
vacancies for special education and related services personnel? What steps 
were tmderway to Improve the s'Ctttewide personnel data systim? 

Most SEA contacts supplemented their responses to the above telephone 
queries by sending psrtlnent documents that helped the study team narrow the 
choice to two states and three backup states (i- casp a state declined to 
participate). 

The work group concurred with the team's recommendations, and the two 
states selected as "first choice" agreed to participate in the pilot study. 
Coincldentally, they were the only two states that appeared on both 
consultants* lists of nominees. 



* The two consultants were Dr. Judy Smith-Davis and Dr. Richard Schofer, whose 
work was referenced in the first chapter of this report. 
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Procedures for selecting LEAs for the study iample . Each of the two SEAs 
suggested at least seven LEAs that: 

• met the "good data" criterion 

• ranged froa low to high for per-capita hires (niuiber of 
special education personnel hired to fill vacancies for the 
current acadeoic year divided by total enrollment) 

• ranged from small to la^e for total enrollment 

• secondarily, represented Bome of the variability that exists 
in the state for factors that affect the difficulty or ease 
of meeting the demand for personnel (e.g., geographic loca~ 
tlon, population mobility, salary schedule, and so forth) 

Each SEA representative restricted his or her recMmendatlons to LEAs 
whose administrators would regard the pilot study as worthwhile, who knew 
about local planning and hiring processes for special edtwation personnel, and 
who could explain local data systems and policies that were pertinent to the 
study's objectives. Two intermediate educational units were included in the 
study because one of the states had a regional organization involved In the 
hiring of local personnel. Study staff obtained Information from representa- 
tives of these units for background only, in order to understand the Intrica- 
cies of regional/local hiring. 

The study team narromd the selection to five LEAs from each state, 
accordlug to the LEA*8 ability to participate, given the study schedule. The 
schedule required that data collection occur during May and June'— a particu- 
larly busy time for LEAs. 

Framework for Examining Personnel PeMud in the Pilot Study 

HIRES by itself might be a cranposite of several measures; the Inquiry 
would have to go beneath the label and examine the local hiring process to 
Identify these measures. Moreover, if BIRES were a proxy for demand of 
special education personnel, very likely there are other independent measures 
of special education staffing; the inquiry would have to determine how HIRES 
Is related to these* At the LEA level, examples of such measures Includes 
size of enrollments by groups of students with particular hwdicapping 



ERIC 



-lo- 
ss 



eonditiooBi olnlfflUB/sBaximua guidelines of states regarding teacher^pupil 
ratios; attrition or turnover rate; state certification requirements. 

It would also be iaportcmt to identify conditions that potentially con- 
found HIRES as a valid and reliable estimate of demand. Examples of such 
conditions include: federal and state policies that affect the ease or diffi- 
culty of finding qualified personnel; the status of "child find" activities; 
competitiveness of salaries for new hires ; the nature and estent of recruitment 
activities; enrollment trends; economic conditions; population movement into 
or out of an area; geographic location, and so forth. These bureaucratic and 
contextual conditions might be hard to quantify, but they are nevertheless 
important for understanding personnel supply and demand in special education. 

These and other factors appear in Table 1 on the next page. Table 1 
shows the framework for examining the demand for special education personnel 
in the pilot study, and represents the thinking of experts and practitioners 
who have studied personnel supply/demand issues at local, state, aad national 
levels. (These sources were referenced in the preceding chapter.) 

Some evaluation questions for the pilot study required quantitative 
Information. The far left column of Table 1 lists several types of quantita- 
tive data relevant to hiring. Most are candidates for independent variables 
in an analysis of personnel denand that uses HIRES as the dependent variable. 

Answering other questions of the pilot study required qualitative 
information such as that in the far right column of Table 1. Some topics, 
such as those listed as "other significant; influences on the supply/demand 
situation in the state or locale," may account for important influences on 
hiring that are not captured adequately by existing quantitative data. Other 
topics in the list concern reporting routines for the quantitative data. 

The framework guided but did not confine data collection. The goal was 
to determine what stumary data were available on HIRES and the factors that 
accounted for hiring (or not hiring). 
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T«bl« 1 

FroMVork for Emmlning Fersoimel Demand in the Strategy Evaluation 



qUMITITATIVE DATA 



ExMi^let of dmtm to b9 obtained if relevmit to 
tlie local p«rsofi»«2 pUooiog mJlilrifia process 



I 

I 



Hires 

• a nevly-hired special cducstloii staff as a percentage of 

a sBiplosrad, by category and baodicappifig coi^iticm 
a a fuli-tliw equivaieota (FTSa) required and a FTCa hired, 

by category and haodicapping cwdition 
a Sources (out-of-^iatrict tranafera; oev graduates of 

in state* out of atate; eootiaoing but nawly-qualif led 

persimsiel» etc.) 
0 Trsi^e over past fev yeara 

Quaaificsticoa of Ken Birea 

a a cartifiad mkd H witb ieaa- than -full certilicatioop by 

cata^ry mid haodlcappist cMdition 
e a qualified io osa araa but nnrlng in aoother 
a Treoda over paat few years 

Eproliaaota md Staff log 
a Ikidt^l icatiM child couat data, by trndlcapping eoodittoo 
(Pt W-142) 

a Percentage of handicapped in total school population by 

type of handicapping cmdition 
a a fecial aducatioo paraotaial aaiploswd, by area and FTE 
a Trends over paat few yaara 



Teacher-Pupil Ratio 
e aiae of ratio 
a data elenenta 
e trends over past fev years 

Faculty Atttiti<m 
a ■agnitude 
a data elenenta 
a patteraa and trcnda 

a aourcea (e*g. , retiraasnt, out-of-dlstrict transfers) 
Vacanciaa 

a a positions budgeted and unfilled, by category md 

handicapping condition 
e a positiooa recruitad fer» by category mad haodicapping 

condition 

a aourcea Ce.g.t program expanaion, loss of personnel) 

a data aleaenta 

a patterns and trends 

Budget 

I {* a for special education teacbera 
\ a par handicapped atodent 

a funding formda 

a traoda over paat fei# yurs 



Sources Froii Wiich 
The Study Tsasi 
Soi^t This InfontatiiMi* 



SEAa 
(»-2) 



LSAs 

(N^IO) 



QUALITATIVE DATA 



Exaaples of topics to be explored vith interviewees 



a Decision process for neeting staffing needs in special 
edi^at ion 

a Reporting: 

- who reports vhat to whom and when, for various data 

cci^cmanta 

- for each coapraentt how collected^ coated, verified * 

updated 

- coat/resources required to do tbia 

- likely prohlraa in obtaining reliable atatiatics of 

theae types; possible solutions 

- opinions ^out «diat data rtiould be reported, and wbat 

tha Federal Goverraent should do t^lth it 

a Uhely future trends for data in far l«f t coliwi 
a gacruitMents 

- fnctora that helped or hindered efforts to recruit ncv 

hirea (certification requirensnta. eccnxwic and 
^ographic factora, claaarora working conditlona) 

- likely futnra trenda 

a Other significant influaneea on tha si^ly/dnand 
rituatioo in the atate, and isplicatlona for a 
national data ayaten, m.g*t 

- dafinitiona used for handicapping conditiona 

- acttitent eligibility criteria for services 
aulti-catesprieal progranBlng 
cooperative arrmvgenents 

- contracting fox aarvicas 

- changing priorities 

- other 



Sources Fron lAiicb 
The Study Tcan 
Sougbt Hiis mforstttioo* 



SEAa 
(H-2) 



LEAs 
(W-IO) 



X 
X 
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The study tea collected only readily available quntilativa data, and tried to <^tain ttm data 
^«'«a aaiating d<H:iMnts, records, and atatiatical raporta bafora and during aite visita. 



Presuaed that SEA databaae was linked to lnL*ivlduii] iM 



Data Colleccion Procedures and Sources 

The study teaa collected most of the infonaatlon durins on-site visits to 
the SEAa and LEAs in the pilot study sample. In preparation for visits, the 
teasi reviewed prelinlnary Inforaatlon obtained by phone and froa documents 
that the sites sent in advance. Once on site, the team interviewed staff who 
were responsible for data collection, analysis, reporting, and management, and 
who were in a position to comment in depth on the personnel planning and hiring 
process and on data and factors that affected hiring, including bureaucratic 
and contextual factors. Other information was obtained from documents, 
records, and statistical reports. To avoid placing undue burden on LEA staff 
at pilot study sites i the team did not request them to prepare new statistical 
summaries . 

Data collection protocols . The study team used the topic outlines in 
Appendix B as guides for interviewing state and local staff. Tables 2 and 3 
provide more detail on numbers of Interviewees, their administrative units, 
and their generic titles. 

Data Analysis Approach 

A variety of analytic activities were necessary to process the quantita- 
tive and qualitative data that the pilot study yielded. These activities 
Included: 

• developing a generic model of the local planning and hiring 
process 

• distinguishing among "levels of demand" that the local 
planning and hiring process revealed 

• Identifying factors associated with each "level of demand" 
that might need to be known and controlled for in a model of 
personnel demand 

• identifying disposing conditions (both contextual and 
bureaucratic) that can have an important effect on hiring, 
whether or not they are measurable 

• estimating in general terms the accuracy, accesBlblllty, and 
the ease of collecting and processing such data 
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Tabl e* 2 

educational and/or Admtoistrative Units 
Represented In the Study Saaple 

iroiEs NuBbers In parentheses are tallies of the SEA and LEA interviews 
coopleted by the study teas. 

• STATE 1 

SEA Level 

Division for Exceptional Children, Support Services (2) 

Division of Teacher Education, Personnel Services (1) 

Division of Student Inforaatlon Manageaent, Controller's Office (1) 

Information Center, Controller's Office (1) 

I£A Level 

School District A (1) Exceptional Children's Frograo 

School District B (2) Exceptional Children's Program; Personnel, 

Evaluation, Certification 

School District C (1) Eiceptlonal Children's Program 

School District D (2) Exceptional Children's Program; 

~* Certificated Personnel 

School District E (1) Bcceptlonal Children's Program 

• STATE 2 

SEA Level 

Bureau for Exceptional Children, Division for Handicapped Children and 
Pupil Services (3) 

Bureau for Teacher Education, Certification, and Placement; Division for 
Instructional Services (3) 

Intermediate Level 

Cooperative Education Service Agency 
Special Education Adnlnlstratlon/Supervision (3) 
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Table 2 (continued) 



School District A (2) 
School District B (2) 

School District C (1) 
School District D (2) 
School District E (1) 



LEA level 

Special Services; Personnel 

Frograo Itevelopaenti Exceptional Education 
Division; Human Resources 

Pupil Personnel Services 

Special Education; Personnel 

AdBlnistration 



o 
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Table 3 
Tally of SEA/LEA Intervievs 



by Generic Titles of interviewees 



STATE 1 



• STATE 2 



SEA Level 



SEA Level 



Consultant /Coordinators (2) 
Project Manager (1) 



Bureau Chief (1) 
Prograo Supervisors (2) 
Consultants i2) 



Center Director (l) 



Office Director (1) 



LEA Level 



Program Directors (2) 
Program Coordinators i2) 
Program Supervisor (1) 



Program Director (1) 
Assistant Program Director (2) 



Intermediate Level 



Personnel Directors (2) 



LEA Level 

District Administrator (1) 

Program Director (3) 

Program Coordinator (1) 

Assistant Superintendent (Personnel) (1) 

Personnel Director (1) 

Staffing SpeciallBt (Personnel) (I) 
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• Identifying specific problems and poss.' »le solutions in obtaining and 
utilising available data 

• developing a statistical suooary of the quantitative data obtained 
fron pilot sites 

The extreaely small sample size, and the considerable variations within 
it, permitted only limited statistical analysis of data from the LEA sample. 
Nor were SEA data files that linked data elements to individual LEAs available 
for analysis by the study staff. 

Intended Audiences for the Strategy Evaluation's 
Findir>gs and Recocmendations 

The findings, conclusions, and recomendations in the remaining chapters 

of this report have a primary and secondary audience. The primary audience is 

OSFP management and the director and staff of the Divis..on of Personnel 

Preparation. The secondary audience is state education agencies. Both 

audiences will be interested in what the local planning and hiring process 

revealed as elements of personnel demand, the utility of existing data for 

determining current and future demand for personnel, and steps that can be 

taken to Improve the federal program's ability to define, measure, and target 

resources to relieve critical shortages of personnel in special education. 
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III. Findinsca and Conelusiongt 
HiRgs as a Starting Point for Bxamininn the Demand for Pe rsonnel 



The study design established HIRSS as a potentially useful estimate of 
personnel demand to be investigated by the study. It broadly defined HIRES as 
a count of the number of relevant staff hired in a specified period. For 
practical matters of collecting data from the study saaq>le, the study team 
defined HIRES more precisely as the number of special education teachiars hired 
by an LEA to fill vacancies (i.e.. budgeted, unfilled positionsi for the 
1936-87 school year . This, then, was the definition the study team used when 
they asked local special education decisionmakers for their "total number of 
hires." 

The study design also proposed that HIRES may not be a single measure but 
instead a composite of several measures. Thus, the inquiry would have fco go 
beneath the label to identify those congponents . To do so would Involve an 
examination of the local personnel planning and hiring process. 

Moreover, the study design suggested that if HI3CES were to be a proxy for 
personnel demand in special education, then it mxat correlate with other 
independent measures of special education staffing. Thus, the inquiry vrould 
have to determine how HIRES was related to these other factors. (Such factors 
Include teacher attrltion/tumover; student enrollmmits c(»apared with state 
guidelines for minimum/maximum teacher-pupil ratios; and state certification 
requirements . ) 

The following sections describe the findings of the study team, using 
HIRES as a starting point for examining the demand for personnel In special 
education. 

The Local Personnel Plannlnn and Hiring Process 

Figures 1 and 2 provide generic models of the LEA personnel planning and 
hiring process. They portray a pattern common across all LSAs in tb6 pilot 
study sample, which the study teaiR was able to identify from discussions with 
local special education decisionmakers (i.e., district special education 
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GENERIC MODEL OF LOCAL PLANNING AND HIRING PROCESS 
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directors and personnel directors). In planning program and staff needs for 
the upcoming school year, local decisionmakers had to determine their demand 
for personnel in two regards: (1) personnel they needed to fill existing 
positions; and (2) personnel they needed to fill new positions. 

Persoimel for existing positions , tecislonaakers had to identify the 
existing positions in the district that had been vacated by staff, and to try 
to fill those positions with other staff. For vhatever reason the position 
had been vacated, the ei^ty slot represented to the district a demand for 
personnel. Before deciding whether to try to fill the position, however, 
local decisionmakers had to examine the iiasffidlate circumstances and their 
available options: Cmild they possibly reassign current staff to cover the 
position? Had student enrollments dropi»d such that they would not need to 
fill It? Could they mc^ilfy facilities or reorganlEe classrocms? Could they 
move students from one school to another? (LEAs typically dislike disrupting 
a student's program and try not to take such action, unless the student will 
be receiving improved services as a result.) 

Having considered their available options, local declBionmakers made 
recCTDiendations based on the Imedlate circumstances in the district (i.e., 
student enrollments, current staff, etc.). Given circumstances (bat were 
fairly stable and had not changed significantly from the previous year, budget 
considerations were not as important as they were for filling new positions, 
because the existing position — filled or unfilled-'had already been approved 
by the local Board of Education, and funding was available to support a fully- 
qualified individual. 

Some recommendations of decisionmakers were to try to fill existing 
positions that had been vacated. The s^dflc reason for the vacancy was not 
important for imiKdiate planning considerations, unless, of course, it was a 
short'term leave. A short-term leave (more than six weeks and less than one 
year, such as a maternity leave) required planners to find an imedlate but 
only temporary replacement. The position was not really vacant — the person on 
leave would soon return. Otherwise, if a position were vacant for reasons of 
retirement, death, or a career change, the specific reason was not important 
for planning and hiring for the upcoodng year. The position was, in fact. 
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officially vacant. That is all planners needed to know. (Xeepins track of 
reasons for teacher attrition/turnover heccHses far more ioqportant idien making 
projections of demand into the future — five to ten, ten to tmnty years. WIm 
will leave, for what reason, and how oftent Local districts did not plan that 
far ahead, so they did not keep track of these data.) 



Once the decision was made to try to fill an existing position, the 
planning phase of the process ended and the hiring phase began. The purpose 
of hiring was to try to fill the position and ateet the denand for personnel. 
Local decisionmakers then sought a job applicant who matched the qualifica- 
tions for the job. The question then became, "Will we fill the existing 
position and with whom?" The answers to this question provided the study team 
with the key for examining the construct validity of HIRES as a measure of 
personnel demand. 



When local decisionmakers answered this question at the end of the hiring 
process, their anstiers fell into one of four categories: 

1. "BO. we did not fill the position, not even with underoual- 
ified staff , tfe have an existing position in the district 
that has been vacated. It's a position that has been 
approved by the school board, and the money is available to 
support a fully-qualified (that means certified by the 
state) individual in that position, tfe have recruited for 
that position to the extent possible in our district, and 
we are unable to fill it." 

2. "YES, we filled the position, but we filled it with sonaone 
who is underaualified . Because we not able to find a 
fully-qualified individual for the position, w selected 
our next best option aiul fillcKl it with an individual who 
has less-than-full requir«iwnts for teaching in this type 
of position in our state. Our need is great enough that we 
thought scxaeone in the position would be better than no one 
at all." 

(SOTB: "Underqualified" individuals include two types of 
personnel : 

a. uncertified personnel — having no certification at all 

b. not-fully-certified personnel— having certification but 
needing additional credits.) 



3. 



"YKS. w filled the existinK poEition with a fully-qualified 
individual . The person m selected has the ^ropriate 
certification required by the position.** 



A. "YBS. we filled the position with a fullv-qualif led individual, 
but we are concerned that the person say be less- than-aualitv 
personnel . The district is not coa^letely satisfied that this 
individual, though fully qualified, has the quality or overall 
competence to teach in this position — in the sense of being 
able to establish rapport with students. Our district is 
concerned with more than just putting bodies in slots." 

(.VOTE: Local districts distinguish between "qualified** and 
"quality." A teacher who is qualified has raet all the require- 
ments for state certification and is, therefore, licensed to 
teach. A teacher who is quality is both qualified and has 
overall "competence to teach." Such coi^tence goes beyond 
meeting the minimum certification requirements for a position.) 

These categories of personnel, then, represented the possible outcwaes of 
the local planning and hiring process for existing positions. But what about 
new positions? Local demand for personnel often included the need to fill new 
positions. Were the personnel plsnning and hiring process and its outcoiDes 
any different for filling new positions than for filling existing positions? 



Personnel for new positions . Major differences between personnel plsn- 
ning and hiring for new positions and for existing positions were in the 
planninn phase. The hiring phase, and the possible outcomes of the entire 
process, were essentially the sane. 



In determining the donand for personnel in new positions for the upcoming 
year, local decisionmakers had to carry out all the activities necessary to 
create a new position. They first had to identify the situations in the dis- 
trict that required attention or that could be iovroved. For exaa^le, they 
had to review the enrollment figures snd teacher-pupil ratios: perhaps they 
were going to exceed the mavimum guidelines established by the state for a 
particular handicapping condition and instructional setting. They had to 
consider whether student needs were being met well by current staff, or if 
current staff were being stretched beyond thei.r limits. They had to consider 
whether current facilities were adequate, or ««hether they had to make 
modifications to create another clsssrss«a. 
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Local declsionaakers then examined alternative approaches for inq^loaentlng 
the i^rov«wnts they were conslderinSt siven the specific circumstances in the 
district. Considering costs and budget issues was particularly important if 
they were going to recmwend that a new position be created. Once the decision 
was made to create a new position, local decisionmakers had to define that 
position more exactly (i.e., program area, qualifications, FTB, etc.) and then 
seek a job applicant who matched the job as they had defined it. They had 
entered the hiring phase and would try to fill the new position they created. 
The question then became. "Hill we fill the new position and with *rt»om?" The 
answer to the question provided the outcome of the local personnel planning 
and hiring process. 

The most important data that local special education decisionmakers used 
for personnel planning and hiring were: 

1. student enroll^nts by handicapping condition, which local 
decisionmakers con^ared with state guidelines for minimum/ 
maximum teacher-pupil ratios by program area and by 
instructional setting 

2. personnel tmdgets 

3. current staffing patterns by school and by program area 

They compared the numbers of students and their needs they had to serve, with 
>he amount of money they had to pay the salaries of personnel to serve those 
needs, with the configuration of students and staffing for each school in the 
district and for the program areas and instructional settings within each 
school. They juggled these data in planning for the upcffioing year and in 
making adjustments throughout the ;ear. The goal of local directors was to 
serve the greatest needs of the greatest numbers of their students, within the 
capacity and coiq>etency of their staffs to serve them, within the budget of 
the district to pay for them and for the appropriate facilities to house 
them. Most directors said that hiring personnel was "an enrol la»nt-driven 
process," but certainly budgets affected the overall ability of a district to 
hire in the first place. 

The characteristics, use, and adequacy of these data for determining 
current and future demand for peraonnel are discussed later in this report. 
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Outcomci of the Local Paraonnel Planniiut and Hirlfut Procasa 

In examinins the results of the local planning and hiring process for the 
pilot study sample (for both new and existing positions), the study team iden> 
tified the following possible outCMMS of the process for trying to fill a 

The (new/ existing) position ronained vacant. The 
district had a budgeted, unfilled position. 



The (new/existing) position was filled but with 
underqualifi^ personnel . 

The nw position was filled with fully-qualified 
personnel . 

The exist inR position was filled with fully- 
qualified personnel. 

The (new/existing) position was filled with 
fully-qualified but less-than-quality personnel. 

The possible outcomes made \sp the construct of HIRES. 

The study team realized that if HIRBS were to be a proxy for personnel 
demand in special education, then any approach for examining current and pro- 
jected demand for would have to take into account all the possible outcomes of 
the planning and hiring process, including HIRBS (broken into its con^nent 
parts) as well as UO HIRSS. tfould it be feasible or even possible for OSBP to 
undertake such an effort? Perhaps a piece of the construct would be useful in 
measuring personnel demand. The study tesm explored the relationship between 
the outcomes of the local planning and hiring process and the demand for 
personnel . 

"Levels of Demand" Apparent from the Outcomes of Hiring 

In asking LBA interviewees about the outcomes of their hiring process for 
the 1986-87 school year, the study team tegm to see an association of each 
outcone with a consonant of personnel damand. Table 4 presents that associa- 
tion in terms of "levels of demand" for personnel in special education. 



vacant position: 
NO HIR5 



HIRB 



e 

v. 
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Table 4 



Levels of Daaand 
for Personnel in Special S ducation 



LEVBL 1: ^deeted. unfilled p ositiong 

Level 1 represents the moat critical denand for personnel in special 
education. An LEA is unable to fill a position that has been 
approved by the local Board of Education, for which funding is 
available to support a fully-qualified (i.e.. certified) individual 
in that position. 

LEVEL 2: Positions filled but with unde raualif ied personnel 

Level 2 represents the next most critical dtfiand for personnel in 
special education. An LEA ht able to fill an approved, budgeted 
position, but it fills that position with an individual who is 
underoualified . 

"Underqualified" means any individual who is one of two types of 
I ' rsonnel : 

(1) uncertified personnel (having no certification at all) 

(2) not-fully-certified personnel (having certification but needing 
additional credits, e.g., provisionally certified). 

LEVEL 3: Haw positions filled w ith fullv-qualif ied personnel 

An LEA creates a new position that did not exist before, and fills 
that position with a fully-qualified individual. This QSH position 
represents a demand for personnel wherever that desand might occur: 
a program area with increasing student enrolliMnts that requires an 
additional position be created; a new program aroa with enrollments 
of students with a -new" or redefined set of handicapping conditions 
that requires a position to be created, etc. 

LEVEL 4: RxtstiM pos itions filled with fullv-quslif ied personnel 

An LEA fills an existing position that has been vacated with a 
fully-qualified individual. For tUbatever reason that fa^Pti^tt 
position has been vacated (retireisant, death, career change, etc), 
the vacant position represents a demand for personnel. 
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LEVEL 5: Poaitiona filled with fullY~quttlif led but leSB-than-tiualitv personnel 

An LEA fills a position with a fully-qualified (i.e., certified) 
individual, but the district is not completely satisfied with the 
quality or cMmetence of that indiviihial to teach in that position. 
This is the level of demand at which an LEA tryina to fill positions 
iroves frwn concerns of quantity and fillina slots to concerns of 
quality and overall cinnpetence to teach . 
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Level 1— the outcoise froa the hiring process of a budgeted, unfilled 
position — represents the most critical desand for personnel. Th«ire is "no 
body in the slot" in spite of the best efforts of the LEA to find one within 
its means* This is a clear and obvious deaand, although so&e variables do 
confound it. (These variables and others associated with levels 2-5 below 
are discussed at greater length later in this section.) 

Level 2 — the outcooe from the hiring process of a position filled but 
with underqualifled personnel — represents the ne»t most critical demand for 
personnel. The person selected to fill the position does not meet the full 
qualifications for the job, either through ccasplete lack of certification or 
through needing additional credits for full certification. The demand for 
personnel— for a fully-qualified individual — is clear, but It is confounded by 
the variable of state certification requlrements-'-and these requirements vary 
from state to state. 

Levels 3 and ^--the outCCTies froa the hiring process of a new/existing 
position filled with fully-qualified personnel — represent a demand for per- 
sonnel, but that demand is only a potential one at srae future time. Levels 3 
and 4 represent a future demand, in the sense of indicating trends — a trend of 
new positions being created in certain program areas, or a trend of existing 
positions being vacated in certain areas, both of which will demand personnel 
to fill them. A new position having to be created, for example, might indicate 
increasing enrollments in the learning disabilities area. Or, as another exam- 
ple, an existing position being vacated might Indicate a trend in personnel 
attrition in the area of emotional disturbance (i.e., the performance require- 
ments of the position are so great that average teacher turnover is every 
three years).* 



* This is the "teacher burnout" phenoronon that appears to be problematic for 
certain groups, such as teachers who work vith students who are identified 
as emotionally disturbed, or behaviorally and eiK>tlonally handicapped. 




Levels 3 and 4 are not disfcii^ulshed for matters of criticality or 
issnedlacy of di^diandt tmt because each is confounded by a differont set of 
variables: Level 3 by student enrolli&ents and all its associated variables 
(eligibility criteria, roinirouai/maxiimim guidelines for teacher-|mpil ratios, 
etc.) that vary from state to state; and Level 4 by personnel attrition/ 
turnover — the reasons for it vary Srtm individual to Individual. 

Level 5 — the outc<»e frm the hiring process of a position filled with 
fully-qualified but less-than-quality personnel — represents a dosmnd for per- 
sonnel, but again that dcunand is only a potential one at some future time. 
The person selected to fill the position has tb^^ full qualification& for che 
job — at least on paper. He or she has met the state certification require- 
ments for the position, and is licensed to teach* Level 5 represents a future 
demand, in the sense of indicating trends — trends of personnel in specialty 
areas, who are certified but do not meet all the professional standards of 
^con^etence to teach." Such trends may indicate d^siand for better- trained 
personnel . 

Level 5 is distinguished from all the levels that precede it because it 
is the level of d^prand at which hiring concerns ol decisio':imakers move fvtm 
ones of quantity (i.e., putting bodies into slots — sc»o^ with full certifica- 
tion and some not — and counting numbers) to ones of quality and overall 
cofl^etence to teach. This level introduces the variable of teacher cc^npe- 
tency, and the need to define the characteristics and cM^etencies of a 
really good** teacher. 

The levels of demand that became apparent to the study team provided a 
logical organizing framework for examining personnel d^siand in special 
education. Their importance to local decisionmakers was that they 
represented the cwnponents of local dooand for personnel, whether or not 
these consonants were converted to numbers and reported formally, or sis^ly 
'^loued in their heaito.** 

Did the outciaM of local hiring meet tV f^lflTt If go> at What level? 
Assuming the purpose of hiring was to try to fill a position and thereby meet 
the draiand for personnel, tbm question arose: **If a certain outccHoe is 
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achieved, baa the demand for personnel at the local level been net through the 
planning and hiring proceas?" Table 5 presents the answers for each possible 
outcose and its associated level of d^iand. 

The answer to whether or not the purpoae of hiring had been achieved pro- 
vided the study team with a clearer delineation of "current" and "projected" 
denand, using HIRES as a proxy for densnd. It also provided a clearer deline- 
ation of the focus of local, state, and federal agencies in determining demand 
for personnel. It indicated which conponenta would have to be examined to 
provide information for current and for projected demand. Levels 1 aad 2 
would provide information on critical and current demand. And all levels— 
1 through 5 — would provide information on projected demand. 

Because they hire the personnel to provide direct services to handicapped 
children and youth, LEAs focus on meeting current demand. When they fill a 
vacant poaition with a fully-qualified individual, they have met that demand. 
SEAs provide assistance to LEAs and coordinate with IHEs, th& producers of 
personnel for the districts. SEAs focus on helping LEAs to meet both their 
current and projected demand for personnel, by coordinating district demand 
with the JHE-generated supply in the state. The federal agency stimulates 
productiv : the supply by awarding grants to IHEs targeted at training 
personnel in critical areas of demand — both current and projected. 

If OSEP were to develop a plan for fl»king nationwide estimates of demand 
for personnel in special education, these, then, would be the components on 
which to collect information. However, since OSEP*s scope is national, and 
OSEP would collect information from all the states, the plan would have to 
Include provisions for the various factors that shape demand across the 
states. Clearly, important variables figured in the dynamics of personnel 
demand at the local level, and these variables would have to be accounted for 
in any itional estimates of current and projected demand. The complexity of 
the problem seemed to grow. 
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Table 5 



The Demand for Peraonnels Has It Been Met at the Local Level? 



The posalble outccanes of the local peraoxmel planning and hiring process 
focus on meeting current demand. Each possible outctsne represents a level of 
demand for personnel. The outctnie may or may not have achieved the purpose of 
the process — to fill the position and thereby meet the demand for personnel. 

Demand can be viewed from the perspective of time. Current (or short- 
term) demand — the focus of LEAs — includes a period of time up to 3 years. 
Projected (or longer-term) demand — the focus of SEAa and the federal level — 
includes a period of time from 3 to 10 years or beyond. Current denmnd is 
concerned id,th the immediate. Projected demand is concerned vith the future. 



Possible Outcooes/ 
Levels of Demand 
— Quantitative — 



Has the demand been met a^ the local 
level through the personnel planning 
and hiring process? 



1. Budgeted* unfilled position 



NO. There is a critical and CURRENT 
demand for personnel at the local level. 



Position filled but with 
underqualif led personnel 



NO. There Is still a critical and 
CURRENT deuic...u for personnel 



3. New position filled with 
fully-qualified personnel 



YES. CURRENT demand has been met. 



4. Existing position filled 
with fully-qualified 
persoxmel 



TES. CURRENT demand has been met. 



— Qualitative— 



5. Position filled with fully- 
qualified but less-than- 
quality personnel 



YES. CURRENT demand has been met. 



o 
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loportant Variables In the Dynamics of Dgnaod at the local Level 

ScMBe variables associated with HIRES were suggested earlier in this section 
in the discussion of "levels of deoand." Table 6 provides a nore detailed list- 
ing of the variables associated with each level. This list is not exhaustive; 
it highlights variables that the pilot study suggested were most important. An 
asterisk (*) appears by the key variable that should be accounted for in using 
with any accuracy the measure with which it is associated. 

Each level of demand added variables to be examined by OSEP for making 
nationwide estimates of demand for personnel in special education. Once again 
the study team considered the possibility of one or two components of the HIRES 
construct being useful to OSEP in targeting federal resources. 

Level 1 — bud geted, unfilled positions— certainly offered the cleanest, 
single piece of data on personnel demand within the HIRES construct, with fewer 
variables to take into account. SEAs and LEAs across the country were likely 
to agree on the definition of a budgeted, unfilled position— a position that 
has been approved and funded, but for which there is no body to fill it. The 
underlying reasons for the position remaining unfilled, however, would have to 
be explored. 

To move to Level 2 — position filled but with underqualified personnel— 
would mean examining the certification requirements of all the states. Since 
"underqualified" refers to two types of personnel ("uncertified" and "not fully 
certified"), a determination would have to be made of which states allow an 
uncertified individual to hold a teaching position and which do not. And a 
range of variations across the states would likely be discovered in the "not- 
fully-certified" category. 

Moving to Level 3 would at the very least involve examining student 
enrollment data, and comparing the state guidelines for minimum/maximum 
teacher-pupil ratios (by program area and by instructional setting). 
Increasing student enrollments typically provide reason for LEAs to create 
a new position and try to fill it with fully-qualified personnel. How many 
more students will be enrolling and what needs will they have for special 
education services? 
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TaJile 6 

Levels of D«Band and Associated Variables 



Findings frost the pilot s*-udy su^^est that any effort to determine current 
and projected donand for personnel cn a national l>a8is, using HTHBS iUO HIRES) as 
a proxy for demand, will also have to examine and interpret data on the key (*} 
variable associated with the specific coE^onent of MIF£S. 



NO HIRE 



Level of Demand 



1. ^dgeted, unfilled position 



Associated Variables 

• geographic location 

• etonmoic diaincmtives 

• district employment require- 

ments (e.g., UTS exam) 

• ability of district tv^ recruit 



2. 



HIRE 



4. 



Position filled but with 
undei^ualified personnel 



Sew position filled with 
fully-»qualifled personnel 



Existing position filled 
with fully-qualifier" 
personnel 



Position filled with 
fully-qualified but less- 
than-quality personnel 



• state certification re^uireronts 
e size/proximity of local supply 

of personnel (li^plications 

for recruitE»nt) 
e state progzvnming policies and 

priorities 
e local staffing decisions 



student e!?><ollments: within 
state ^v'idelines for mi>iimum/ 
maxiiman teacher-pupil ration: 
student eligibility criteria 
state programming policies and 
priorities 



* e teacher attrition/turnover 



* • quality of supply: appropri- 
ateness of IKS tctdning; 
individual ccovetence 



BOTE: The ability of a district to hire at all depends on its level of fundimc . 
This is the larger context in which the d«aand for personnel, and all its 
associated variables, must operate. 



Kovins to Level 4 wuld mean collecting date from all the states on 
teacher attrition/ turnover and the specific reasons for it. A vacancy in an 
existina position occurs when the individual holding the position vacates it. 
This is obvious, hut the reason the person leaves the position is important. 
People leave for different reaiions. Leaving a position because the job is too 
stressful and unrewarding is a significantly different reason for leaving than 
is attrition because of death. To predict demand. '*who will leave, for What 
reason, and how often" is important information. 

Moving to Level 5 would mean assessing the quality of training in special 

education provided by the colleges and universities in the country, establish- 

inf, the competencies of a "quality" teacher, and measuring individuals against 
those competencies. 

Bach variable associated with a level of demand raises questions for OSEP 
to consider in developing a plan for estimating nationwide demand for personnel 
in special education. These questions are discussed in Ch^ter VI of this 
report. 

conclusions Belated to the Major Ouaation tb« Pilot Study i — Is HIHSS ^ . 
accurate eg«-<««»** »f d ^nA f if net. What other variables and condition? are 
associated with hirina that minht n eed to be specified and controlled fort 

0 Hires as a single measure does n e t provide an accurate estimate of demand . 
It is a composite of several measu res, each of %diich must be examined 
separately . 

An examination of the local personnel planning and hiring process revealed 
these coiiq>onent measures. The purpose of the process is to try to meet local 
demand by (1) hiring personnel for existing positions, and by (2) hiring 
personnel for agw positions. The possible outcones are the same for both: 



CO 



{ 



NO HIRE < • The position remained vacant. The district had a budgeted, 
unfilled position . 

''9 The position «#as filled but with underqualified personnel , 
e The new position was filled with fully-qualified personnel. 
HIR£ / OR 



e The existing position was filled with fully-qualified 
personnel . 

• The position was filled with fully-oualif ied but less- 
than-quality personnel . 

Bach possible outccnae is a ci»nponent of personnel donand. Bach ctHi^nent with 
its count of personnel noist be examined to obtain any accurate estimate of 
demand. 

• Other variables and conditions associated with hirinx naist be specified and 
controlled for, if HIBBS trere used as an estimate of^^raonnel daaand . 

Each con^onent, or measure, of HIRES has important variables associated 
with it. Table 6 of this report sutmnarizes scMse of them. If OSEP were to 
undertake any effort to determine current and projected demand for personnel 
in special education on a national basis, OSBP would have to examine data on 
the most important variables. For the ccnnponents of HIRBS of immediate 
concern to OSEP, these variables are: 



— Budgeted, unfilled position 



Position filled but with 
underqualified personnel 

Hew position filled with 
fully-qualified personnel 



Existing position filled with 
fully-qualified persoimel 



— Underlying reasons for position 
remaning unfilled 

— State certification requirements 



— Student enrolliwnt data: within 
state guidelines for minisaja/ 
maxlm^mi teacher-pupil ratios 

— Teacher attrition/turnover 
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• Dpon eataainatlon of the construct of HIRES as a pro«y for personnel demand. 
thlTpilot stuAy has determined tliat as a single acasurc wltMn the 
^5Str5ct> m HIRES <i.e.. i>ud8eted. unfille d positions) seeaa to offer the 
nSwst eatinate of current (up to 3 ye ars) and critical deaand for 
personnel in special education at the present time . 

Certainly, special education decisionmakers would agree on the definition 
of a "budgeted, unfilled position." They point out, however, that the under- 
lying reasons for NO HIRES oust also be explored. Does the position remain 
vacant for a long time because of the geographic location or economic disincen- 
tives of the local school district? Does the individual district actively 
seek qualified candidates, or is it passive in its recruitment efforts? And 
why? To be an appropriate target for federal program resources, the underlying 
reason must be possible to address through personnel preparation (i.e., 
training). 

To provide a more adequate estimate of current demand, NO HIRES data 
should be supplemented ifith data on underqualified personnel. Local school 
districts consider that they have met their current demand for personnel onl^ 
when they have filled their vacancies with f ully-q -alif led teachers. Adding 
underqualified personnel to estimates of current demand requires further 
breakouts of data into: 

• numbers of positions filled with uncertified personnel 

• numbers of positions filled with not-fully-certified personnel 

To move beyond current and critical demand, and make longer-term projec- 
tions of demand for personnel will require that OSEP address numerous other 
problems to make these projections accurate. These problems are discussed in 
Chapter VI of this report. 

Local Demand for PersonneH 
Conclusions from the Pilot Study Sample 

Since the study team nas to examine HIRES as a proxy for personnel demand, 
one of the first questions staff asked of intervieiwes at the local level was, 
"What was your total number of hires for the 1986-87 school year?" Their 
uncertainty about the question caused staff to state it more precisely: "^t 
was the total number of special education teachers hired to fill vacancies 
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(that iSf bud^dted, unfilldd sK>8ition8) for the school year?" Bvon than it 
became necessary to break apart HIRES further to get an accurate picture of 
personnel dcanand frras the pilot study senile* 

Table 7 at the end of this chapter provides specific data Svtm the dis- 
tricts in the pilot study sai^le. It presents that data for **total niu^r of 
hires** for each district, and for each of the levels of dMiand revealed by the 
outcomes of the local personnel planning and hiring process. (It does not 
present data for Level 5, because the study was to te strictly a quantitative 
one, not qualitative. Level 5 is the only c<^onent of dcanand concerned 
strictly with issues of personnel quality, and that refers to quality beyond 
state certification. 

The quantitative data on each of the ci^onents of HIRSS did not provide 
much information on the areas of current and critical d^nand for personnel 
across the ten districts in the study sample. Viewing dcorand in terms of the 
HIRES model (d^oand e number of tnidgeted, unfilled positions ^ number of 
positions filled with underqualif led personnel), the data revealed: 

e Two of the ten districts had budgeted, unfilled positions — 

1 teacher of the trainable mentally handicapped 

1 teacher of the autistic 

e Three of the ten districts had positions filled with under- 
qualified personnel — 

1 uncertifi^ teacher of the iMhaviorally and optionally 
handicap:^d 

5 not-fully-certified teachers: 3 teachers of the ^sotionally 
disturbed and 2 teachers of the learning disabled 

1 not-fully-certified teacher of the ^otionally disturbed 

Of the total numter of HIR^ (182) across the ten districts for the 
1986-87 school year, the current draand for teachers was nine (2 budgetiHlt 
unfilled positions ^ 7 positions filled with underqualif led personnel). The 
conclusion fvxm these figures is that there is no major problra* However, the 
quantitative data alone is misleadina . Qualitative data frra the local 
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districts provided additional Infonnatlon on teacher demand that was essential 
for identifyins shortages. 
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Qualitative data obtained froio local decisionmakers in the form of 
anecdotal statements provided essential information for identifying shortages 
in the sample districts: 

e Although districts were able to fill most of their positions, 
local decisionmakers identified areas of "shortage" as positions 
that «fere "hard-to-fill,- and personnel idio ware **dif ficult-to- 
find," requiring extensive recruiting. Typically, such shortages 
included: 

— teachers of the emotionally disturbed . (Teacher turnover in 
this area is three years on the averse due to the tr«iiendous 
demands of the position.) 

— teachers of speech and lanauaae. (Some districts consider 
speech and language to be a special education teacher 
position; s<»ne consider it to be a related services position.) 

— occupational therap ists and physical therapists. (Almost 
unanimously, the districts in the sample identified OTs and 
PTs as their most difficult-to-find personnel. These are 
related services positions, not special education teacher 
positions . ) 

a Because of the age of their special education teaching staff, 
several districts see sizable shortages coming within the next 
three years, especially if early retirement bills are passed by 
state legislatures. 

a Because of newly-increased state certification requirements in 
the multicategorical program area, close to half the staff in 
several districts will becon» "underqualified" next year. 

In this pilot study sample, it was the statements of local decisionmakers 
that, in fact, identified the donand for personnel in these districts. SKAs 
and OSKP would not have known about this demand, homver, because the numbers 
reported to them could not provide a complete picture by themselves. 

Ai>oth0r dMH«?ct^on became apparent to study tesm staff— the distinction 
between "revealed demand" and "unrevealed demand." This was even yet another 
variable that OSBP would have to consider in determining current and projected 
demand for personnel. 
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Th« nature of the "unrevealed demand" described by the pilot study sample 
was in terms of "hard-to-find" personnel. LBAs had to use more extensive 
recruitins efforts to locate such personnel. And the reasons that these 
personnel were difficult to find also varied: trom "the schools cannot afford 
to pay the salaries these personnel can t^t in the private setting- to "the 
positions in this program area are so stressful, no one wants to go into it." 

"Unrevealed demand" was also embedded in the numbers themselves. Inter- 
viewees suggested a variety of reasons for state and federal counts of 
personnel being lower than they should for presenting a true dennnd picture, 
based on actual requiren»nt8 for personnel to serve the Qge^ of handicapped 
children and youth. These aspects of "unrevealed demand" have been mentioned 
throughout this report. Such factors include state use of unduplicated counts 
of children, accounting only for their primary handicapping condition and not 
any secondary conditions they might have; state limitations on the nuniber of 
children that can be identified within a particular handicapping category; the 
overall ability of a district to hire, based on the amount of state and 
federal funding it receives. 

Tn .nnMuaion. collf*r,t:in« both Q u imtltative data and qualitative d<^ta 
from local weial educa H nn dacisionn'^i"*'^ ^« aaaAntial for maltinn nationaj 
intimates of d«n^il. Bsti g u.t.in. Amimnd for t)ersonnel-c»rren<: or future-also 
rftfluirea an i^eeounfeinK o f fi>ctt.ra that contribute to "unrevealed de^nand . 

Analysis gaf«p^» Pa^a; 

A Basis for Wationw ^da gatimatftfl of PemandT 

one purpose of the strategy evaluation was to find out whether data are 
readily available from LKAs that can provide the basis for nationwide estimates 
of teacher demand. «hile the small sai^le of LBAs in the evaluation limits the 
reliability of actual estimation, the study team conqnited estimates of the 
national market demand from the »aaplB to indicate the value of these data, if 
they were to be supplemented with data on several dozen other representative LBAs 
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Table 8. Enrollaeot and Staff Sizes In Sampled LEAb* 



State 1 



Total 



Special Education 



LEA 
A 


forollst 


Staff 


Ratio 


Enrollot 


44,100 


2,300 


19.0 


3,800 


B 


21,500 


1,350 


15.9 


4,840 


C 


23,900 


1,350 


17.7 


3,820 


D 


16,700 


1,050 


15.9 


3,110 


£ 


18,100 


890 


20.2 


2,370 


Subtotal 124,300 


6,960 


17.9 


17.940 


State 2 










A 


6,000 


390 


15.3 


570 


B 


92,800 


5,220 


17.8 


9,480 


C 


7,600 


480 


15.7 


610 


D 


4,600 


270 


16.7 


460 


E 


800 


60 


12.2 


90 


Subtotal 


111,700 


6,430 


17.4 


19,670 


Total 


236,000 


13,380 


17.6 


28,610 



250 
130 
170 
140 
80 



15.4 
36.9 
22.1 
21.5 
27.9 



8.6Z 
22. 5Z 
16. OZ 
18. 7Z 
13. 2Z 



10. 6Z 
9.7Z 
12. 8Z 
13. 8Z 
9.6Z 



780 23,0 14. 4Z 11. 2Z 



50 
870 
70 
40 
10 



10.8 
11.0 
9.3 
11.8 
11.2 



9.5Z 
10. 2Z 

8.1Z 
10. IZ 
12. OZ 

9.6Z 

12. IZ 



13. AZ 
16. 6Z 
13. 8Z 
14. 2Z 
13. OX 

16. OZ 
13. 5Z 



* Values shown in the table have been rounded. Exact values were used in the 
estloatlon procedure. 



An Important question regarding the utility of analysing the sample data 
concerns the representativeness of the sample. The nationwide teacher-pupil 
ratio, based on extrapolation of figures in the Digest of Education Statistics 
(1987), is 17.8; and the nationwide average percentage of pupils counted as 
requiring special education is 11.2Z (ibid.). These figures can be compared 
with the data for the sample, presented in Table 8. 

Based on these two statistics, the sample a ppears to be representative— 
at least it is not noticeably nonrepresentative. The values for the two 
states bracket the national estimates. In both cases. Nevertheless, note that 
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one LEA contrilmtes 40% of the totals, so the results are quite unstable. The 
ffiost strikins pattern in Table 8 is the difference between the two statea' 
special education teacher-pupil ratios . Although the overall teacher-pupil 
ratios are 17.9 and 17.6 for the two states, the special education teacher- 
pupil ratios are 23.0 and 10.3. This difference does, in fact, reflect the 
official guidelines of each state for class size n^ximuias in special education. 
Conclusions should not be drawn from this difference, however, without examin- 
ins the differences between the states' definitions of handicapping conditions 
and program areas of special education. 

The general nethod used here to produce national estimates is ratio 
eetimatioji. To estimate the number of new special education teachers required 
nationally, compute the ratio of new special education teachers required in 
each LSA to the number of students in each LEA and compute a weighted average, 
weighting each LBA's statistic so that the total number of students adds up to 
the total number of students in the nation. The basic assumption of this 
approach is that the saiiq>led school districts are representative of the nation, 
in the ratio of new special education teachers needed to number of students. 

The number of students can be taken from the total enrollments or from the 
special education enrollments. Total enrollments might be expected to be more 
reliable, because of variability in the definitions of handicapping conditions; 
but special education enrollments are more closely tied to special education 
staff requirements. For the purpose of generating national estimates, the 
present example uses the figure 45,300,000 for total enrollment, based on the 
1987 Pixest of Education statistics , and 4,380,000 for special eihication 
enrollment, based on the 1987 Annual Report by OSBRS to Congress. Sote that 
these figures do not corroborate the national estimate of 11.2* of students 
being in special education. This may be because nonpublic school enrollments 
are included in the total enrollment figure for the present exaa^lo. In 
applying the estimation procedures to a larger study, care would be needed to 
differentiate between demand for public school staff and for nonpublic school 
staff. 



An Idea of th« •mount of variability in the reeultins eetimatea i« conveyed 
by the range tetween the values obtained froa one of the two states and ivcm 
the other. Between-state variability is more iaportant than within-ativte 
variability, because staffing criteria are let at the state level, so the 
limitation of this study to two states severely limits the reliability of the 
analyses. Hevertheless, presenting the estimates indicates the feasibility of 
the ratio estimation methodology. 

Table 9 presents the data on special education hiring in the sampled 
districts, divided into existing positions to be filled because of exiting 
teachers and positions that are newly funded. These data include both HI8BS 
and m> HIRES, i^ich add up to the total d^aand the LBA places on the marhet. 
Clearly, d«nand between districts varies substantially , and the study team does 
not have data to indicate the extent to idiich the variation is a year-to-year 
phenomenon or a stable characteristic of LBAs. Certainly, some LSAs, such as 
those with military bases, experience higher turnover rates than othera. but 
the study was not large enough to investigate relations to school district 
characteristics. The most striking pattern in Table 9 is the finding that 
most of the demand for teachers is due to turnover o f teachers in existinK 
positions . not to the creation of new positions. iAiile new positions might 
provide employment for an additional 2% each year, roughly 1 in every 12 
» existii^g positions in special education becM.es vacant and requires L^placement 

each year. 

Using the results represented in Tables 8 and 9, estimates can 
generated of the nationwide doaand for special education teachers to fill 
advertised positions in LBAs. Using the total enrollment weighting procedure, 
the estimates are 6,100 teachers to fill new positions and 28,800 teachers to 
fill existing positions. Using the special edu cation enrollment ifeiKhting 
procedure, the estimates are 4,800 teachers to fill new positions and 23,000 
teachers to fill existing positions. 
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Table 9. Special Education Staff Needs in Saapled LEAs 



State 1 

New Positions Existing Positions 



LEA 


Number 


(X of S£ Staff) 


Nuober 


(X of SE Staff) 


A 


7 


2.8Z 


12 


4.9X 


B 


5 


3.8X 


0 


O.OZ 


C 


0 


O.OZ 


8 


4.6X 


D 


1.5 


1,01 


15.5 


10.7% 


E 


3.1 


3.7H; 


22.9 


27. U 


Subtotal 


16.6 


2.1Z 


58.4 


7.5Z 



State 2 



A 


2 


3.8Z 


2 


3.8% 


B 


9.1 


I.IZ 


73.9 


9.0% 


C 


2 


3.0Z 


6 


9.1% 


D 


2 


5.1% 


6 


20.5% 


E 


0 


O.OX 


20 


25.0% 


Subtotal 


15.1 


1.5% 


91.9 


8.9% 


Total 


31.7 


1.8% 


150.3 


8.3% 



The ranges of these estimates l^tveen the two states for requirements for 
new positions are 6,000 to 6,100 (for total enrollment weighting ) and 4,100 to 
6,200 (for special education enrollment weighting ). The ranges of these 
estimates between the two states for requirements for existing positions are 
21,300 to 37,300 and 14,300 to 37,700, for the two weighting procedures. 
Thus, if computations were based on State 1, using special education enroll- 
ments for weighting, this would estimate the market to offer about 18,400 
positions; but if cimputations were based on State 2, also using special 
education enrollronts for weighting, this would estimate a need for 43,900 
positions. That is, analyses based on the pilot study sample of ten LEAs in 
two states can only provide ballpark estimates . 
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Additional Inforaatlon is required In crder to provide aore than very 
rou ^h information on the size of the special education teacher market . First, 
many of the positions are filled by teachers moving between LKAs, and an 
estimate of the percentage of the supply that must be produced by institutions 
of higher education is required in order to use these data for planning 
purposes. Moreover, these data are specifically not allocated to specialties 
vithln special education, and such a breakdown is essential in a larger study 
whose purpose is to provide national estimates. Finally, this Illustrative 
example has not addressed market segmentation: how important is it to develop 
regional estirostes and estimates by type of district? 

The point of this computational exercise was to demonstrate the 
feasibility of the approach, not to provide reliable estimates of demand for 
the current year. 
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IV. Findings and CoacluBionsi 
Available Data on HIRES and Related Variables 



In the course of Inquiring about the local personnel planning and hiring 
process , the study team asked special education dedslonaakers In LEAs Co 
Identify data they keep track of and use to deteralne their denand for 
personnel. Knowing what data LEAs consider In oaklng decisions about local 
personnel planning, hiring, and staffing would assist the study teaa to (1) 
clarify the definitions and ccnplezltles associated with determining the 
denand for special education personnel, and (2) alert model builders or other 
Investigators to swae of the data that may be available (or unavailable) for 
measuring current demand and projecting future demand for personnel. 

The following discussion of data that LEAs used to determine their need 
to hire personnel and to document outcomes of the hiring process focuses on 
the data*ss 

• nature and availability 

• accuracy 

• adequacy and utility for measuring current demand and 
projecting future demand 

Nature and Availability of the Data 

Table 10 lists the primary Indicators or measures that special education 
decisionmakers in LEAs considered in making decisions regarding personnel 
planning and hiring. Table 10 also shows which of these data were available 
at the SEA level in the two pilot states. (Although the focus of the pilot 
study was the local level, the availability of data at the state level that 
figures in local definitions of personnel demand and in hiring practices was 
important to determine. SEAs are the gateway through which the Federal 
Government obtains quantitative data on local personnel demand.) 
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Table 10 



Data Inventory 

The general question we asked intervimmes was, **Do you keep track of 
the following infonnationf If yes, do you use it in personnel planning, 
in making hiring decisions, or in making projectionsT" 



Data Category; miditet 

Budget and/or expenditures for 
special education teachers 

Per pupil cost for handicapped 
students 

Funding formula 



LBAs (10) SEA #1 SEA #2 
10 Yes yes 



On On 
request request 



10 



Yes 



Yes 



Yes 



Data Category: gnrollawnt. Staffina . 

and Teacher-Pupil Ratios 

(fnduplicated child count data, hy 
handicapping condition (P.L. 94-142) 



10 



Yes 



Yes 



Duplicated child count data 
(hy primary and secondary handi- 
capping conditions) 

Pementage of handicapped in 
total school population by type 
of handicapping condition 

H special education personnel 
enqployed, by area and 
full-tifl» equivalents (FTBs) 



10 



10 



10 



No 



Yes 



Yes 



Yes 



Yes 



Yes 



Teacher-pupil ratios 



10 



Yes 



Yes 



Data category; Faculty Attrition 

Ifagnitude of attrition, by program lO Yes Yes 

area or handicqyping condition 

Sources of attrition 0 vill Yes 

(e.g., retir^Mnt, out>of -district 
transfer, changii^ careers, death) 

Attrition of teachers in their 0. 0. 0 Yes Yes 

1st year, 5th year, lOth year 
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Table 10 (continued) 



Data Category: Vacancies LEAa (10) SEA ll SEA #2 

N positions budgeted and unfilled, 10 Yes Yes 

by category or handicapping 

condition 

N positions recruited for, by 10 Will No 

category or handicapping condition 

Sources of vacancies (e.g., prograa 10 Will Yes 

expansion* loss of personnel) 



Data Category: HIRES 



N newly-hired special education 
staff, by category and handicapping 
condition 



10 



Yes 



Yes 



N PTEs required and N FTEs hired, by 
category or handicapping condition 

Sources of HIRES (e.g., out-of- 
dlstrlct transfers, new graduates, 
continuing but newly-qualified 
personnel) 

Seniority list (If layoffs are 
necessary) 

Breakouts for HIRES by type of 
certification, and emergency/ 
temporary status 



10 



10 



10 



10 



Yes 



No 



Yes 



Yes 



N/A 



Will 



N/A 



Win 



Data Category: Qualifications 

of Mew Hires 

N certified and N with less than 10 Yes Yes 

full certification, by category or 
handicapping condition 

N qualified In one area but 10 Yes No 

serving In another 
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What data were available ? The indlcatora or seasures In Table 10 cluster 
under six caf.egoriess (1) budget; (2) enrollaenti staffing, and teacher-pupil 
ratios; (3) attrition; (4) vacancies; (5) hires; and (6) qualifications of new 
hires. In the table* the order of the six categories corresponds to the 
sequence of the local personnel planning and hiring process in Figures 1 and 2 
of the preceding chapter. That is, special education declslotuBakers in the 
pilot study sample used data under the first four categories to deteralne new 
and existing positions to be filled, and they used Indicators under the fourth, 
fifth, and sixth categories to docui^nt outcoaes of the hiring prTOess. 

Not surprisingly, the formal reporting requirements of local, state, and 
federal levels determined what data were most likely to he maintained 
systematically by LEAs in the study <iample. F'jr er ample, under the 
"Vacancies" category In Table 10, the statistic call^i^ "N positions budgeted 
and unfilled, by category or handicapping condition" tias readily available 
because of reporting requirements. Although the statistic called "sources of 
vacancies" was available (in the sense that the special education decision- 
makers who vetB interviewed often knew the reasons positions had been 
vacated), LEAs did not necessarily obtain or systeanatically record these 
reasons. A different example is the per-pupll expenditure ststlstlc under the 
category "Budget." LEAs in the study sample could provide It on special 
request, but they did not report it routinely. 

As Is apparent from Table 10, some data that LEAs could supply were not 
necessarily available from their respective SEAs in breakouts for special 
education . And the SEAs collected additional detailed personnel data from 
LEAs for state-level analyses, «^ch LEAs did not necessarily use for local 
planning and hiring. Neither SEA was presently making Its dstabases available 
for others to use, and neither state* s data system could provide outsiders 
with a "query" capability. 

How far back were data available ? For the most part, personnel data that 
were currently available from LEAs and SEAs were also available two to three 
years back, at least. In addition, some LEAs were putting historical data on 
personal computers and mainframes for ease of access, and for personnel 
planning purposes. 
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yhat form tha data in ? The form in \Ai!.ch data iiere availabla from 
ISAa varied considerably, froa handwritten calculations, lists, and susmiaries 
to formal coa^uter printouts. Obviously, the largest LSAs needed formal dPta 
systems the most; they had the most data to handle. Consequently, the data in 
Table 10 were more likely to be readily accessible in summary form from large 
LKAs than from anali LSAs. For example, the largest LEA in the pilot study 
sas^le (total enrollment 9'»,000) had a very sophisticated data system. The 
smallest LBAs in the sample (total enrollments of 750 to 20, 000 > kept track of 
much of the data in Table 10 informally. Interviewee from the smaller LBAs 
said they had some of this information "in their heads" because their special 
education staffs were small and easily tracked. 

Both SSAs also had very sophisticated data processing capabilities and 
data systems. They could link separate databases to run raalyses that would 
address specific, timely questions about personnel sttpply and d«aand. They 
could disaggregate data to produce some local and regional summaries. The 
specific nature of analyses changed from year to year, according to the 
questions of highest priority. 

What were report inn routines for these data? Data collection and 
reporting by LBAs in the study sample revealed the following pattern. During 
the school year, LBA advisory committees and decieionmakers assessed program 
and staff needs (February, Harch), and LBA staffs updated enrollment 
statistics (three or four times) . A June 1 "head count" was required by the 
Federal Government as the basis for making PL 94-142 allocations, and was the 
primary means by which the SBA monitored the minimum/maxianan enrollment 
guidelines for each program area. Late Hay or early June was also the time 
when special education directors in LKAs again reviewed their personnel and 
program situations, using data such as that in Table 10. Having determined 
the demand for personnel in the upcoming year, they made reconmendations— 
sometimes in the form of annual plans — for the local boards of education to 
review. June was also the month whei. the local boards reviewed district 
budget requests for the coning year. (The special edu'sation budget %fas 
typically part of the LSA*s overall budget, and could not be distinguished 
from it except through special calculation.) The boards also considered any 
local advisory ccMaaittee assessments of program and staff requiroaents at this 
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tlmn. Once lEAs received board approval, they tried to fill vacancies before 
the next school year; thus, susBoer was often a key time for recruitment and 
hiring in B»ny districts. Other districts » particularly the larger ones, had 
to start this process earlier. They too, however, had to recruit and hire up 
to the last minute if they had positions that were "hard to fill." 

In addition, LEAs had to m&et standard pr(^edures and requirraents in 
providing data \.o their SEAs. In State 1 , all school-level personnel 
(teachers) are required to suteit a form to the state in mid-September to 
early October via their LEA coordinator. The form asks for information such 
as type of assigiment (by full-time equivalent, or FTE), class enrollment, 
ethnicity, experience status (new hire, etc.), and source of funds. The 
database from this is used for a variety of purposes, including LEA program 
planning. As of Itecember 1, LEAs report "continuing needs/unfilled positions" 
to the SEA. The SEA susmiarlzes the data for its "End-of-Year Report," and for 
its report to the Federal Government. In State 2 , teachers complete a simi- 
larly detailed, individual report and return it to the SEA by October 1, 
update it In February, and return it the following October. Other submissions 
include the LEAs* plan of service for special education (suteitted in May and 
resubmitted in August), and enrollment reports, sulnnitted the third Friday In 

September. 

SEA data collections from their LEAs are major efforts. Data collection 
forms and procedures have been perfected over the years, with impressive 
results, such as improved accuracy and (in one recent case) a nearly lOOX 
response rate on a voluntary survey. ScH&e of the lessons learned are summa- 
rized In the Recommendations chapter as suggestions for building a m<^el data 
system. 

Accuracy of the Data 

The study team did not function in the role of auditors who verify the 
acccuracy and reliability of data that LEAs use to determine the need to hire 
(see Table 10). Rathei, the team asked about the local process for producing 
and checking data. 
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As the above discussion indicated, LEAs checked and updated their data 
regularly throughout the year. They attributed any errors that crept into 
their data at the state level to bureaucratic "bigness" and to the nunbers of 
people handling their data. In addition, local da.a cane under the scrutiny 
of local advisory groups, parents, and school boards. Presiaaably, each of 
these parties shared the goal of serving handicapped children while avoiding 
litigation in the process. 

For the aost part, both SEAs used standard, computer-based verification 
procedures to improve the accuracy and reliability of their data. Also, they 
instituted data collection strategies that significantly reduced opportunities 
for errors. 

Federal data (reported by SEAs) and respective state data (reported by 
LEAs) did not necessarily correspond, however. In the pilot study, LEA and 
SEA interviewees attributed discrepancies* to a variety of possibiUties, 
including the following: 

• SEAs used unduplicated counts of students— representing their 
prioary handicapping conditions— as the basis for estiaatlng 
personne l demand. LEAs used duplicated counts— representing both 
their primary and secondary handicapping conditions— in determin- 
ing personnel dwnand. In other words, from the local perspective, 
many children may have less severe needs resulting from their 
second condition (such as speech and language problems), but they 
are still needs that should be served. This implies a greater 
demand for personnel than the primary condition alone would 
indicate. 

• If an SEA identified a greater number of students as eligible for 
special education services than the SEA had the funding to 
support (such as emotionally disturbed children and youth— the ED 
category), the SEA would be legally required to serve them 
whether or not the dollars were available. Thus, levels of 
funding for special education could lead to the phenomenon that 
one SEA interviewee called "unrevealed demand" for personnel. 

• If an SEA placed a cap on numbers of children that could be 
identified with a specific handicapping condltiTu (e.g., LD), it 
might disallow as "overidentiflcation" the n^mht'.t of children a 
district identified beyond that cap. The <»lstiict still faces 
the problem of serving those students, although they may not 
appear as numbers at the SEA level. 

^ These are examples oTpractices or situations that contribute to under- 
estimating the "true" demand for personnel. 
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Resources Required to Prcwiuce the Data 

The study team aslced LSA and SEA Intervievees to Indicate the "cost" of 
collecting and aalntalnlng the data In Table 10. In other words, what funds* 
equlpTOnt, specialized staff, and technical assistance were Invested In order 
to obtain accurate, useful data? 

LEAs were unable to cost special education data collection and reporting 
because these tasks had becc^e such an integral part of overall district 
operations. Fven special education directors had difficulty estimating what 
percent of their time they spent on these tasks, because they did them 
piecemeal throughout the year. 

Both SEAs in the sample said that the resources required to obtain and 
use LEA data were changing rapidly. Thanks to sophisticated computer hardware 
and software, and the growing number of LEAs that were using personal craputers 
and specialised software to store and report personnel and program data, both 
SEAs expected that it would becone increasingly more economical to obtain 
accurate data for local, regional, and statewide personnel planning. 

The two SEAs also realized economies by Improving their data collection 
forms and related instructions, and by providing technical assistance to LEAs 
to help them improve local data collection and management. In Chapter VI, 
Reconmendatlon #3 Incorporates these and other lessons learned by SEAs (and 
LEAs). 

How LEAs and SEAs Used the I^ta for Dete«Bining Current 
and Projected Demand for Special Education Personnel 

Local special education decisionmakers used the above data along with 

other information to determine program and staffing needs for the upco&lng 

school year, and to identify situations that needed roaedylng during the 

curreii*. school year. Tbey looked back In time at enrollments, by handicapping 

condition, to Judge wuether these enrollmnts were stable. Increasing, or 

decreasing. However, LEAs did not use these historical data to develop 

projections of personnel dmand beyond the eating school year — nor did they 

anticipate that att«Bpting longer^ange projections for their LEAs was a 

particularly useful thing to do. Their focus was on obtaining approval for 
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Buffldent FTE units to meet personnel demands for the coming academic year, 
given a finite amount of local, state, and federal funds. 

Both SE*ifl In the pilot study sample used the data they obtained from LEAs 
to meet federal and state reporting requirenants , including the SEA*s 
Comprehensive System for Personnel Development (CSPD) plan. These SEAs also 
used the data, in conjunction with other databases, for special-purpose 
analyses . Examples were analyses that: 

• identified areas of current and projected teacher shortages 
statewide (with breakouts for special education areas). They 
compared turnover rates with the state average to spot current 
critical shortages. They noted lAether special education 
turnover rates in some areas were higher than the state average. 

• compared regions on a number of program and staffing dimensions 

• determined enrollment and staffing trends by special education 
area 

In State 1 , one major difference between LEA and SEA estimates of demand 
for personnel was that the LEAs used duplicated child counts to determine 
local service requirements (the LEA focus), while the SEA used undupllcated 
counts to estimate statewide personnel shortages (an SEA focus). 

A second difference was how "forward planning" each tried to be by using 
data. LEAs' analyses focused on the Immediate a nd very near-term (i.e., 
current demand), the boundaries of their accountability for local programming 
and staffing. SEAs looked to tbe future (i.e., projected demand) in order to 
address questions put to them by their state legislatures, their governors and 
state superintendents of public instruction, their institutions of higher 
education, and their own planning and budgeting staffs. 

Examples of SEAa' efforts to wedlct personnel demand and related 
trends . Since 1979 one SEA had contracted with one of its universities to 
conduct focused assessments of special education service needs. This SEA had 
been prompted to request additional assessments as a result of its own 
surveys. In addition to assisting the SEA to meet federal reporting 
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requlreoents of P.L. 94-142, the objectives of this annual statevlde 
assessoent were to: 



• predict special education personnel demand In the state 

• provide a basis for predicting trends and changes In the field 

• provide data that could be used to construct an overall 
picture of the eaplojnBent oarket for special education 
teachers. The state»s Institutions of higher education 
(IHEs), In turn, could use such a profile as a baals for 
directing students toward areas of critical deoand for 
personnel (and away frOT> areas that anticipate surpluses) 

• provide Information that IHEs could use to Improve the quality 
of their personnel preparation programs 

Both SEAs had vastly upgraded their data processing technology in recent 
years, and both employed ataff who were attempting to Improve the SEA's 
ability to do long-range educational forecasting— for all of education, not 
Just special education. For example, one of State l *s Ideas for projecting 
trends In personnel demand was first to develop ratios for current demand 
(staffing level) by program category, using full-time equivalents (PTEs) of 
personnel and numbers of students (enrollments); and then to project the 
ratios across time, taking into account ratios from prior years. After 
projecting the ratios, the ratios could be converted back Into numbers of FTE 
personnel required. State 2 . through contracted assistance, was trying 
another procedure to develop projections of special education personnel, Ite 
elements (predictors) were: 

• the number of newly prepared teachers graduated from IHEs In the 
state; to this number, apply the (known) percentage of those who 
will actually enter teaching In the area for which they trained 

• the number of emergency licenses (as an Indicator of "need" for 
particular services) ; to this number, apply an attrition factor 

• the number of children served ( duplicated count) ; to this number, 
apply a .:orrectlon factor for projected growth of a program area 

These SEA Interviewees acknowledged that the complexities and pitfalls 
confronting their efforts to develop long-range forecasts were formidable. 
For example, a common concern was that changes occur so fast In important 
predictor variables, such as funding levels, priorities, legislated 
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requlrenents and prograna. etc.. t hat baaing projcctloas on current aad 
historical data la a qnestlimable practice . Nevertheless » both SE&a were 
using historical data to Bake projections for planning purposes and for 
advising their state-supported institutions of higher education to adjust 
personnel production to meet anticipated denand (or to cut back personnel 
preparation prograas in areas of anticipated surplus). 

The above discussion points to some of the problems experts at the state 
level confronted in atteoptlng projections that generally do not even run 
beyond five years. Producing even longer-term forecasts (e.g., five to twenty 
years) for a federal strategy of targeting critical demand for personnel— 
because the personnel production system (IHEs) Is a slow-response system- 
would raise even greater problems. The next chapter discusses further the 
conclusions of the pilot study on the limitations and utility of LEA and SEA 
data for a federal targeting atrategy . 

***** 



Investigating strategies of meeting the demand for special education 
personnel was outside the scope of the pilot study. However, at the request 
of the work group, the study team did inquire about recruitment strategies In 
Its interviews with LEA and SEA staffs. 

Status of Recruitment by LEAs and SEAs 

to Meet Demands for Special Education Personnel 

The consensus among LEA and SEA staffs in the pilot study was that the 

ability to recruit personnel Is a significant factor in whether or not local 

districts or particular geographic regions "experienced critical shortages" 

(their term). Interviewees also conceded that Just knowing particuUr personnel 

would be difficult to recruit (i.e., hard to find, limited supply) might 

discourage LEAs from budgeting such positions at all. (This is a source of 

"unrevealed demand.") The perception of the pilot study sample is consistent 

with that of other investigators, who acknowledge that the recruitment 

situation (including Incentives and disincentives) must be known and taken 
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into account In order to Interpret data on areas of critical desand for 
personnel (McLaughlin, Smlth-Davla, & Burke, 1986; Schofer & Davis, 1986; 
Schofer & Duncan, 1984; Smith-Davis, Burke, & Noel, 1983; Yates, 1987). 

The context for recruitsent . In State 1 , until recently, LEAs vere 
responsible for recruiting personnel to fill vacancies. In 1986, the state 
legislature authorised a program that established a Teacher Recruitment Office 
(TRO) in the SEA's Division of Teacher Education. The TRO: 

• develops and analyzes data on teacher supply and demand . For 
example, the TRO identifies requirements of individual LEAs 
for teachers in particular subject areas (including special 
education areas). 

• coordinates and administers a comprehensive recruitment 
effort . The mi works with 341 appointed high school teacher 
recruiters and with 8 regional teacher recruiters (the latter 
having been selected as "teachers of the year") to attract 
talented high school students into the profession, to provide 
information about teaching, and to improve the field's 
professional image. 

• coordinates efforts to develop programs that attract and 
retain capable teachers , especially minorities and 
individuals who may not otherwise consider entering or 
continuing a career in teaching. For example, the TRO 
administers scholarship/l<»n and incentive programs. 

• conducts statewide aarketing campaig ns. The objective of a 
recent csmpaign was to enhance the image and attractiveness 
of the teaching profession. 

An advisory council assists the IRO; its members represent <>ducation 
groups, the lay public, business and industry, media organisatiras such as 
radio and television broadcasters, and other groups that might enhance the 
impact of recruitment efforts. 



The TRO holds meetings in each region to train the 341 high school teacher 
recruiters , and meets monthly with the eight regional "teachers of the year" 
who work full time in their respective regions with the local TRO high school 
recruiters. (The TRO's emphasis on marketing careers in teaching to high 
school students acknowledges the importance of recruiting during the second or 
third year of high school, as colleges do to recruit for collegiate sports.) 
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In State 2 , LEAs were responsible for recruiting personnel to fill 
vacancies* The SEA acted as a clearinghouse by providing a ccraputerlzed 
placesent service* Graduates looking for positions conpleted applications » 
indicating their geographic preferences and their certification; information 
on these applications was stored in the cc^puter database. When LEAs sent 
announceoents of vacancies to the state » the clearinghouse staff sent the LEA 
a printout of qualified applicants* The SEA said that the greatest hindrance 
to efforts of recruiting special education i^rsonnel was ccmpetition frcm 
other states* recruiters* 

This state did not offer teacher incentives, leaving such setters to 
individual LEAs* The SEA acknowledged that the Incentive issue was most 
critical for LEAs in resote* rural areas of the state. The state legislature 
considered an early retirement option » which would act as an incentive by 
allowing teachers in the system who met tenure requirements to retire early 
with full benefits* The bill was defeated, but interviewees were certain it 
would come up again next year* (The needs assessiNtnt consultant in this state 
said that early retireront would have little impact on the number of openings 
for special education personnel, because the sj^cial education teachers in 
this state are on average ten years younger than teachers in other subject 
areas* 

The LEAs* recruitment situation ^ In the study sample, most of the LEAs 
did not have to do heavy recruiting (except for certain program areas) because 
they were in desirable areas with low unemployment. 

In the low^tumover LEAs, and in districts with a good reputation in a 
desirable location, special education directors and personnel directors had 
access to active files of well-qualified applicants from which they could 
select the ''cream of the crop.** For example i one special education director 
in such an LEA said, ''People Just seem to walk in when we need them.** 



* This is a good example of how appropriate breakouts (by subject area) of a 
readily available piece of data (average age of teachers in existing 
positions) enabled one observer to predict the impact that a major piece of 
legislation would have on the demand for special education personnel* 
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Recrultsent in low-turnover districts focused on "difficult-to-find" 
types of personnel. Tt^se included seobers of ainorlty groups, which were 
difficult to find in general because of the sany Job options available to 
qualified candidates. Other difficult->to-find personnel included occupational 
therapists (OTs), physical therapists (FTs), and teachers of the emotionally 
disturbed (ED). 

Whether UAa recruited locally, statewide, regionally, or nationally 
often depended upon whether local colleges produced a sufficient supply of 
qualified personnel in categories that Batched LEA vacancies. For example, 
one LEA had a university in the area that offered the second largest teacher 
training progrwa in the state — a ready supply. 

LEAs* recruitment methods . Directors of special education and personnel 
directors carried out recruiting activities, both Jointly and separately. 
Special education directors tended to be more involved with local recruiting, 
and personnel directors with regional or national recruiting. 

The followicj strategies provide a composite picture of the recruiting 
activities of LEAs in the study sample: 

• At colleges and universities: 

- Special education directors spoke in person to various 
special education and related services departments at local 
colleges and universities. 

- They established working relationships with appropriate 
professional staff in these colleges and universities. 

- They recruited selectively at specific colleges and 
universities (not Just those within a 2(Hnlle radius); they 
did this out of a coBDltment to find the best personnel. 

- LEAs had recruiting booths at local colleges and attended 
job fairs. 

- They contacted career planning and placement people and 
posted Job announcements at these institutions. 

• LEAs advertised in newspapers, newsletters, and magazines of 
professional associations. 
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• They did some recruitment out of state, usually In other 
surrounding states. 

• They conducted national searches for adalnlstrators or other 
hard-to-flnd personnel. 

Most LEAS lamented that they could not offer teacher Incentives because 
of tight budgets. One LEA offered dlfflcult-to-*lre personnel a "systen-nrlde 
contract," meaning that they could guarantee a job to a college student 
anywhere In the district upon graduation. Other LEAs gave provisional 
certification. If necessary, to keep existing staff— an action strongly 
recommended by teacher unions—rather than offer real Incentives to draw new 
people into the district. 



LEAs also commented on the difficulty of competing at Job fairs with 
"slick, out-of-state, professional recruiters" whose booths, marketing 
materials, and recruiters drew more attention from prospective applicants. 

The link between r ecruitment problems and supplies of personnel . SEAs 
and LEAs agreed that recruitment problems will persist for personnel in areas 
or short supply. As pointed out earlier in this chapter, both SEAs have 
formal relationships with their institutions of higher education (IHEs), 
through which they try to Influence IHE staff to counsel students to prepare 
for program areas in sAlch large numbers of positions are currently filled by 
underqualified teachers, or for areas in which unfilled vacancies persist, or 
for areas In which teacher-pupil ratios are pushing maximum limits. 

Conclusions and Insights 

Findings from the pilot study led to the following conclusions and 
Insights about thv* data that supported local personnel planning and hiring 
decisions. 



Available data were used to determine curr«it. not projected demand . 
Data that LEAs used to determine their demand for periionnel focused on meeting 
^V^^^"^ °«e<J8 of students for special education and r«lated services. That is 
idiat LEAs must do, and their present data systems and available data suit that 
objective, LEAs did not project their future demand for particular kinds of 
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personnel, nor did they see the need to do so for local progranalng 
r.taffing. 



SEAS in the pilot study were making sooe headway with techniques for 
projecting the demand for particular kinds of personnel, but pointed out major 
obstacles to attempting to develop reliable long-term projections (beyond 
three years). 

A« data moved u p through the system (from LEA to SEA to federal), the 
data became less useful and accurate for TOasuring loca l demand for personnel. 
Presently, the major channel through which OSEP obtains state-by-state data on 
personnel demand is through SEAs, whose counts do not necessarily correspond 
with LEA determinations. The preceding section of this chapter documented 
possible reasons for such discrepancies. 

Moreover, the most informative data summaries of SEAs pertained primarily 
to interests of state-level policymakers, who did not necessarily ask the same 
questions cf the data from year to year, and lAose questions did not always 
match the information needs of federal-level policymakers. Finally, one SEA's 
estimates of personnel demand were derived frwa imduplicated counts of stu- 
dents; the other SEA*s estimates were based on duplicated counts. Obviously, 
these estimates are not comparable. (A point to consider for any future data 
collection that seeks SEA estimates of local demand is accommodation for 
differences in estimatijs due to use of unduplicatcd or duplicated counts.) 

Because larne LEAs were^ »*fltilfgd to handle larger quantities of data^ 
thev were more likely than small lEAs to have s ophisticated data systems that 
aystematicallY maintained data and gould nake it more accessible in summag 
form. The sheer volume of data that large LEAs (total enrollments above 
20,000) handled made it necessary to institute systemstic recordkeeping 
procedures end relatively sophisticated data collection and management 
strategies for a broad array cf data. 
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Reporting routines were trell iforked out and running saoothly. although 
reporting burden was Increasing . In both states, various exponents of the 
data collection and reporting process had improved steadily over the years, 
and LEAs adhered to fon&al guidelines that SEAs provided. SEAs and L£Aj in 
the study sample observed that foraal requirements and special requests for 
data (from both state and local requestors) vere increasing, in spite of 
efforts to coordinate data collection activities. 

Data that LEAs used to determine the need to hire appeared to be accurate . 
LEAs updated district and classroom enrollment data at regular intervals (three 
to four times a year), and local advisory boards and boards of education 
provided further scrutiny. 

LEAs and SEAs were unable to indicate the "cost" of collecting and main- 
taining the data they used to determine demfmd for special education pfersonnel . 
Reasons vere dianges in the nature and costs of resources for data entry, 
processing, analysis, and reporting, and the absence of formal cost-benefit 
studies. At the LEA level especially, a major reason for being unable to cost 
data-related tasks was that LEA staff "arried out such tasks piecemeal through- 
out the year, working them into their daily routines. (Obviously, more 
sophisticated equipment is costly but promises eventually to reduce the time 
for data processing, analysis, and reporting. Although mastering sophisticated 
technology requires a significant Investment of time at first, this diminishes 
as the learning curve materialises.) 

Lag time i.n the system exceeds lead time in short-term projections (up to 
three years) . Lag time for the federal f'inding cycle (which starts two years 
ahead of awards) and for grantees^ programs to produce graduates (say, three 
to five years) makes it questionable to base grant award decisions on short- 
term projections, those most likely to be available from SEAs. SEAs acknowl- 
edge major difficulties In using historical data for forecasting beyond three 
years. (Even if every SEA could develop accurate flveto ten-year projections 
of personnel demand by level and handicapping condition, it is unclear what 
that would tell SEAs to do about persranel preparation programs in their 
respective states, how fast their IHEs could respond, and ^t the consequences 
would be for addressing national and regional shortages.) 



'67- 

35 



V. Discussion and Inpllcations for Recoaaendlnit Wwct Steps 
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Identifying Severe National Shortages Ca n Be Easy 

Because teachers are employed in local districts* teacher supply and 
desiand is a truly local phenraenon. The pilot study suggested that identify- 
ing shortages of special education personnel has quantitative and qualitative 
aspects, which local special education decisiomaakers specify in planning for 
the upcoming school year. They express the magnitude and character of their 
current demand for personnel in terms of numherB of positions, qualifications 
desired of applicants for those positions, and service needs of children they 
want to meet by filling r^ositions with fully-qualified individuals. They can 
specify the categories and speciality areas of personnel that are difficult to 
find or (possibly) in short supply. They can describe exactly the employment 
Kitting in which teachers will work. 

This kind of local information is extremely relevant for the federal 
targeting strategy. However, federal data requirements from states and aggre- 
gated data do not provide a view of teacher demand with the clarity, accuracy, 
and timeliness of that in local school districts. As the data from individual 
districts is merged at the state level, and data from Individual states is 
merged at the federal level, the local data loses the qualities that made it 
useful: a clear, accurate, and timely picture of teacher supply and demand in 
a unique local district. Moreover, variations across districts that were 
apparent from the study's analysis of sample data argue against the utility of 
statewide or even regional reporting. 

Implications . Federal annual reporting requirements may be unjustified. 
At a minimum, there is justification for seeking a more efficient, economical, 
and less burdensome alternative. (See Eecommendation #2 in Chapter VI,) 

The Hard ^art Is Interpreting National Data On Demand 

Even wit: • betier way to obtain data on shortages, the federal program 
Dust still interpr et that data to define and select priority areas, and Justify 
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its allocation of tralalng resources aaong then. Interpreting national data 
on demand requires understanding th'* factors that Influence both demand and 
supply of special education personnel. 

Many Important factors Influence the demand for persnnnel . In the pilot 
study, the HIRES model offered no single measure of demand. Numbers of 
budgeted, unfilled vacancies (NO HIRES) and numbers of positions filled with 
underqualifled personnel did not answer questions like these: Vhy did the 
vacancy occur? What is the prv^ability that the vacancy will recur, and how 
soon? Can the training and recruitment aspects of the vacancy be distin- 
guished? How long did the vacancy remain open? What types of locations are 
over-represented where unfilled vacajcies persist? 

Table 11 (at the end of this chapter) provides an organizing franwwork 
for examining the components of personnel demand . The inf onmtlon in Table 11 
was compiled from Tables 4, 5, r.nd 6 in Chapter HI. The "data questions" 
provide a focus for future data gathering and research- 

The last column of Table l.l suggests how various «*ata might be used by 
federal program managers (or by decls5 comakers at institutions of higher 
education) to focus resources for personnel preparation. The actual utility 
of the data for these purposes could be empirically evaluated. 

Very little is known about the supply side . Who will actxjally accept 
positions in special education for which they were trained? Who among former 
teachers will return and when? Which teachers will continue and for how long? 
Who will enter from out of state? Under what conditions might a person decide 
to teach (enter the supply pool)? How do economic and demographic factors 
Interact with state policies to increase or decrease supply? How are available 
data on supply defined, computed, collected, and verified? (These questions 
are based on discussions in Olson & Rodman, 1987, and in Hawley, 1986.) 

Few IHEs have followup data on their trainees and what they do after 
completing training for careers in special education. Neither SEAs nor LEAs 
are tracking attrition and turnover in a manner that helps to predict the size 
of the special education teacher force by category, specialty area, or the 
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handicapping conditions they are qualified to address (Schofer & Duncan, 1984; 
Schofer & Davis, 1986). 

Manipulating a single variable nay alter supply and demand draaatlcally . 
Consider the variable of state certification requirements. When a state 
responds to its teacher shortage in a given subject area by lowering its 
standards for who is qualified to teach, it at once increases the supply of 
eligible applicants for vacant positions in that area, thereby making it 
easier for local districts to fill their budgeted vacancies. 



Alternatively, raising certification standards for teachers as a strategy 
for improving the quality of services to children creates an isBmedlate shortage 
of staff who meet the higher requirements. 

Writing on teacher supply and demand. Roth (1986) named three questionable 
staffing practices that have become widespread in education generally, and 
which are most likely to occur in personnel categories where demand exceeds 
supply: (1) issuing emergency certifications j (2) providing alternative routes 
to certification; and (3) out-of -field assignments— allowing teachers to teach 
outside of the field for which they were trained. Out-of-field teachlns assign- 
ments are obscured by state certification systems that allow teachers to teach 
a wide range of subjects, or to teach children with a wide range of handicapping 
conditions. 

Implications . Understanding how various factors influence both supply and 
demand helps to Interpret national data on personnel in special education. 
(See Recommendations #3 and #6 in Chapter VI.) 



Data Ages Fast 

Data that local districts provide is for current positions (filled or 
unfilled), current enrollments of children with various handicapping conditions, 
current certification status of their teachers, anil so forth. This information 
is out of date by the time it is aggregated at the state level and then reported 
to the Federal (ktvemnent. 
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In fact, by the time the data reach the federal level, the funding cycle 
for awards two years hence Is underway. Inevitably, theni data in states' 
annual reports and infomatlon In their CSFD plans are not as useful as they 
were Intended for deciding how to target training resources* 

Implication . Identify statistical means of Improving the usefulness of 
available data for targeting resources, e.g., for identifying trends and 
assessing stability of various indicators of demand. (See Recommendation #4 
in Chapter VI.) 

Short-Term Projections Fall Short of the Lag Time In the System 

Lag time in the system has several aspects. One Is the federal funding 
cycle, which starts two years ahead of awards. Add to that the time it takes 
for grantees' programs to produce graduates (say, three to five years). Then, 
schools of education need sufficient lead time to adjust their programs to 
emerging priorities for personnel preparation, and to counsel students into 
areas where demand will exceed supply. 

Implication . Focusing federal training resources on the basis of 
short-term projections is questionable. However, SEAs acknowledge major 
difficulties in using historical data for forecasting beyond three years. A 
recent survey determined that SEAs are reluctant to make projections beyond 
the current year (Schofcr & Duncan, 1984). 

In addition, to be useful for targeting federal training resources to 
emerging demand for personnel, projections must account for new service 
delivery models requiring new types of personnel and staffing arrangements. 
SEAs are unlikely to be able to predict when such shifts will occ r, and how 
dramatic technological advances and other "system changes" will alter the 
future demand for special education services.* 



* Even if every SEA could develop accurate five- to ten-year projections of 
personnel demand by level and by handicapping condition, it is unclear what 
that would tell SEAs to do about personnel preparation programs in their 
respective states, how fast their IHEs could respond, and i^at the 
consequences would be for addressing national and regional shortages. 
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Prospects for Accurate Long-'Range Forecasting Are Dismal 



Over the past thirty years, the nation has seen major swings between 
teacher shortages and teacher surpluses. If accuxate long-range projections 
of demand for special education teachers were available t schools of education 
would welcome them in counseling their si udents. 

Projections of national school enrollment one or two decades into the 
future can be achieved with reasonable accuracy, based on population demo- 
graphics. Therefore, with assumptions about the stability of state guidelines 
for teacher-pupil ratios, the total demand for teachers can be projected. The 
problem lies in the necessity for projecting the perceived demand for teachers 
with special certification to address students with particular categories of 
need. 

Although most Americans can agree on the value of devoting special effort 
to the education of children with special needs, the amount of effort to be 
put into their education is constantly at issue. Therefore, the funding for 
special education is likely to vary with the political winds — and these winds 
are responsive to a variety of unpredictable factors unrelated to either edu- 
cation or children. The level of funding for educational programs over the 
past twenty-five years gives caution for describing the future of special 
education. Federal funding is a major force in determining the lurKet for 
special education teachers; that reason alone makes market projection perilous. 

Even Ignoring the political and litigious framework in which special 
education operates, wide-ranging questions are constant about the appropriate 
delivery of special education. In particular, issues of appropriate contexts, 
conditions, forms, and levels of mainstreaming are likely to redefine the 
market for personnel in special education for a long time to come. 

Long-range projections also necessitate predicting himan behavior , which 
Is often unpredictable* e.g.* who will actually enter the teaching force and 
who will leave, and for what reasons (Darling-Hammond for RAND, in an unpub- 
: shed concept paper for the Center for Statistics* current study of staffing 
and schooling). 
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Iapllcatloii > Given this context i the estimation of desand for special 
education teachers Is still meaningful, but only within the range of time that 
political forces are unlikely to have great effect. These projections » based 
m current measures of demand and demographic projections will serve some oi 
the purposes of a strategy for targeting resources to areas of critical demand 
for personnel. (See ReccHnmendations #4 and #6 in Chapter VI.) 

The Impact of Politics and Money in Shaping^ the Demand for Personnel 
Obscures Children's Needs for Services 

Decisionmakers in local school districts attempt to meet all the needs of 
their students for special education and related services. True* many children 
may have less severe needs resulting from their secondary handicapping condi- 
tion (such as speech and language problems), but they are still needs that 
should be served. 

The pilot study *s examination of local personnel planning and hiring 
indicated that local decisionmakers weigh available options for TOetlng service 
needs 9 and may decide not to hire if they can work out a satisfactory solution. 

Unrevealed demand . Politics and money play a large part in '^revealing*' 
the demand for personnel » and in affecting the ability of districts to attract 
and retain quality teachers (Darling-Hammond, 1987; Hawley, 1986; and Battler 
& Battler 9 1985). 

Factors that contribute to "unrei^aled de^oand" Include: the availability 
and level of funding for positions, which affect the overall ability of dis- 
tricts to hire; state limitations on numbers of children that can be counted 
(identified) in particular categorical areas; and representing service needs 
of children according to their primary handicapping condition only (i.e., with 
unduplicated, rather than duplicated, counts). 

Implication . The real needs of children for services are obscured by 
estimates of demand derived fr<» counts of budgeted, unfilled vacancies; 
positions filled; and the certification status of personnel in those positions. 
(See Recoimsendation #7 in Chapter VI.) 
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Uodear Concepts and Ternlnology Further Coaplicate 



Attecpta to Pin Pown Shortages and Focus Resources 



Education Veek (Olson & Rodaan, 1987) quoted the National Academy of 
Sciences* 19!R7 interim report on teacher supply and demand saying that fuzzy 
concepts and absence of agreed-upon terminology fuel the controversy about 
whether or not there are teacher shortages. The Personnel Preparation Program 
faces the same situation. 

At present, inferences have to be made for how the federal program defines 
terns such as supply, demand, shortage, and need. Reading the 1966 amendments 
does not help much; the language says the program should focus resources in a 
manner that meets the "demand" for personnel according to identified "short- 
ages." Reading the program's regulatory language, grant announcements, and 
data collection forms still leaves no basis for distinguishing between demand, 
shortage, and need. For example, none of these sources makes clear the dis- 
tinction betiraen the '*demand for personnel" and a child's "need for service.** 

"Supply" is hard to define precisely too. For Instance, the "98-199 form" 
that grantees fill out to report the numbers of persons trained dues not dls^- 
tinguish between those who are new teachers and others. Program regulations 
require an emphasis on "preservice" training, implying a lesser emphasis on 
special education teachers who are already employed. However, further sleuth- 
ing would determine that "preservice" includes new teachers md continuing 
teachers who are working toward full certification, or certification In a new 
service category. 

Reading grant announcements in each of the priority areas for new and 
continuation ftmding implies several connotations for "shortages" that the 
federal program is trying to address through training support! (1) unmet 
needs of children for service; (2) market demand that exceeds the existing 
supply of personnel in particular categories or specialty areas, and in 
undesirable geographical areas; (3) tmderrepresentation of minorities in the 
supply of special education and related services personnel; and (4) Inadequate 
numbers of fullyqualified personnel, including those to m^et the needs of 
newly-Identified service groups (e.g., infant service providers). 
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The pilot study suggested that local districts define shortages la both 
quantitative and qualitatlv>ii terms* Shortages included (1) budgeted, unfilled 
vacancies; (2) positions filled with tinderqualif led staff; and (3) categories 
of personnel who were especially hard to recruit, and so forth# 

Implication , The targeting strategy requires clarification, as do key 
terms in the lav, the regulations, grant announcements, and data collection 
forms. To do so requires agreeing on: (1) the nature of shortages that can 
be addressed through training; and (2) realistic expectations for the program's 
targeting efforts » given the legislative mandate » available resources » and the 
inability to guarantee that those who complete training will enter the market 
(supply) for careers in special education. (See Recommendations #1 and #5 in 
Chapter VI*) 



Given these implications, what suggestions are in order? The next 
chapter presents the study team's reccwnendatlons — most t )t implementation 
now, some to be implemented over the longer term. 
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A rraMwrk for Focuains raturv RMsarcb 

WTSS: All data would ba coHactad bf eaiasorlcal araa af apacial education. 
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I^ yal of Dacand 

mnu: Bach ''laval*' ia a aaaaura 
of local da«af^ for 
]»araonnal . 
(lafar to Cb- IXX. Tablaa 4, S» 6) 



Tba Proxy for Daaand 
That 19 Aaaoeiatad 
With Tbi« Lairal C*> 

CRafar to Ch. Ill, 
Tabla 6) 



Tba Variablaa that 
Wwra Aaaociatad Witb 

NXnS/flO ffXItIS At 
Tbla Uyal of Pawand 

CBafar to Cb. IXX, 
Tabla 6) 
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braoboMta for data 
eollaction. 

CBafar to Cb .XV, Tabla 10) 



Rxai^loa of How tba Data 
Nay aa Uaaful for Tarsatiof 

iMoureaa for Rarsomal 
Praparat ^oo Caod RacntiUwit) 
VOTE: FUtura atudiaa will asplri 
callr taai tha data*a util 
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Thia saaaura rapraaanta tba woat 
critical damnd for paraonnal at tba 
local laval. An LSA ia tinabla to 
fill a poaitioft that baa baan 
approvad by tha local Board of 
Bducation, for wbicb fimdins will 
support a fully-qualif lad Ci.a., 
cartlfiad) individual in that 
position. 
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Gaoarapbic location 

Sconoaic incantivM 
or diaincaotivai 

District anploywnt 
raquirasants Ca.^., 
VTS ajcaa) 

Bacruitnant problaM 



Wbat is tba ga^rapble 
locotion of tba vacancy Y 

tlhat is tbs distribution 
of vacancias acroaa 
l^atiofiat 

How local aalary acalaa 
ciwqpara with salary scalaa 
for coapotittt oppcrtimi- 
tiaaf 



Faraiatmt vacancias in axistina 
prograa araaa sugs^s^ naad to 
Incraasa production in axiatins 
training prc^raas. 



Data indicata 
ab^rtagaa . 



araaa of critical 



(*) Tba proxy for desiand that the pilot study axaninad m» HIRBS/BO HIHM. 
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ftofor to Ch* III. 
TAblo ft) 



tato fMotlms to Bo 
tomiorod ot SEULEk Lovol 



IJM«rlliio donotoa 
braakouts for data 

eolioctim 



BxM^los of lkM# the Data 
Kay Bo UMful for Tarfiatlng 
Mawrcaa for ParaiN!ii«i 

Praoafa^icm {mn6 gfy r^ityont) 

won*, ruturo att^loa nlll anplri- 
cally toot tha data'0 util- 
ity for dociaioroaiiiiiR. 



Lawl 2i Poaition fillod twit with 
imdarouaHfiod oora<miHii 

Thia Maaura rapraamta tho naat 
aN>8t crltieal daaiai^ for porMmiol 
at tho local lovol. Jin LtA la ablo 
to fill an a|»provad, twd^otod 
swsltion, but filla It vlth an 
InOWi^l nho la undormaliflod. 

''Undorqualiflad'* amna havii^ loaa 
than full cartif leatloA, i.o,, 

o ufi^ar^^^f^ paraoimol 

o not-fulliy-c^rt|^f^fd poraoimal 



HIM 



stata certifica- 
tion practices 



Is the paraoo 
C*)-- iincartlfied y 

Ci.o.* havSfis €ortifl> 
cation, hut needing 
^Itioml credits, 
e.ft*» provlalfmalljr 
eortifl^)? 



Indlcataa areas i^ra training in 
thaae speclallxad skills is noodad. 

Apply if% a turnover factor to thaga 
msBbers nay help predict future 
shortage areas. 



SIze/proKlmliy of 
local aupply of 
paraonnal Ci«pllca- 
tiona for recniltflMmt) 

State progra—lng 
policlea aj^ prlor- 
itlea 



Inf onset Ion on these vari- 
ables is siso li^rtant to 
emaider In Interpreting 
data oo HtlWS* 



Local atafflng 
dacialona 



C*) Findings froai tha pilot atudy suuasted that these data are lltely to be available fron LIAa. 

i ( Ij C**) Flndlnga fro«i the pilot att^y suggested thet eny effort to detenilae aid interpret current and project daaand for personnel on a national heals, 

^ ^ using HIBgS iWO HIMS) aa a proxy for daaand, will have to inclute ^«.a m the key (**) variola associated with the specific ''level of 

deaiand,*' ai^ make that data con^rable. i O 

1 i 

The proxy for dawand that the pilot study exaiained was NlRn/iO HIMS. 
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Uwl pf ^mmd 

won: Isch '^l^Ml" is • M29ur» 
of • pi«c0 of Ihm locttl 
d«uiid for p«r«imml. 

(tof«r to Ch. Ill, T^bloo 4, 5, 6) 



Tim Proxy for Piind 
TtMt la taooeUtad 
With Thio IMWU*^^^ 



CBofor to Ch. 
Tablo 6) 



III. 



Tho fori^loi That 
Vara Aoaociatad With 

fflUS/ao HJ»S At 
Thia Layai nf PmwntI 
CKafar to Ch. Ill, 
Tabla 6) 



Data Quaatiooa To to 
^ytaw^ad ^% thf IMh Uaval 



LovaA 3; 1^ ooaition fiilad »<ith 
fully-QtiaUffiad oaraonnal 

Thia aaaaura rapraaants daawnd that 
did not axiat bafora« hn LEA craataa 
a oaw poaition and f ilia it with a 
fill ly-^uallf lad individual. 



Ihtdarlioa dmotaa 
brritouta for data 
col lac t ion 
ftofor to Ch.lf, Tabla 10) 



Bkaaiplaa of Hm tha Data 
May to Uaaful for TarBatlns 

Saaourcaa for torsimial 
Prwaratiogj (and tocniitmnt), 
MR; mture ati^loa will aMpiri- 
eally taat tha data 'a util- 
for da< iaiimaafcinR. 



(Saa m%t paga.) 



HIR8 



Xa tha paraoo 

ft)— naifly aiialif iad for 
apaeial adacatlonT 

C*)~froai tto aaiatlfift pool 
of qualif iad apaeial 
adticatiofi taachara 
(i.a. , Koving around 
in tha ayataa)? 



a Suss^>fc« araaa i^ra tha aniatins 
pool ia abia to Mat taMuid Cfor 
oow) » 

a Susgaata araaa whara trainins 
prograaa ahotild ba oaintainad 
or axpandod. 



sD 
I 



Did tha paraon hirad coaa 
f roai an im (w LBA) 
c»)->ip tho atataf 
(»)-^taida tha atatat 



Haa laplieationa for racrtiiting for 
varioiia araaa of apaeial adyeation. 

Suuasta axtant to lihich atata'a 
para<Htfial pro^ctioo inatltutiona 
aaat local daaand for paraonnal. 



Did tha now poaiMon arlaa 
froH 

C*) — a proaraai araa 
(with aural laamta of 
atudMta with a "^naW* 
or radaf inad aat of 
handicappifig eOTidi- 
tiofia)f 



Suggaata naw akilla art raquirad 
and p«rhapa naw aarvica da 1 ivory 
aodala* 



l*)--oroaraa axoanaion (to 
abaorb ineraaa^ io 
anrollaanla)? 



a &iggaata naad to axpand paretmnal 
praparation in thaaa araaa. 



erJc 



C») Flndinga froai tha pilot atudy auggaatad that thaaa data ara lifcaly to ba availabla froa UAa. 

(*«) Pindinga fraa tha pilot atudy mtggaatad that any affort to dataraina and intofprat currrot and projact daaand for paraonnal on a fw^lyywH baaia, 
using ^f pa y (ao ^ ^ftJp^} aa a proxy for toMnd, will haira to incli^ data on tha hay C**) variabla aaaociatad with tha apacific "laval of 
daaand,** ai^ aaka that data coeparabla. 



Tha proxy for demand that tha pilot atudy axaainad was NIRSS/WO H18BS, 

lOS 
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Tiibitt 11 Ceontimiad) 

ygvBi of p^ana 

HOTS: Baeb "IftVttl** ifi a MA8ur« 
of • pUco of Vim local 
a«Mn4 for porsonnol. 
Cftefer io Ch. 1X1, Tablos 4» 5, 6) 



Tho Proxy for Daund 

Ttmt Is JUi«o€iiatod 
WAtb TMg Lovoll***) 

CRofor to Ch. Ill* 
Tablo 6) 



mo forioblos Thol 
Mro AssocUtod Witb 

HXRSS/ffD HXUS At 
TMo Uirol of OmmA 
(Rofor to Ch. XIX« 
Tablo 6} 



Uvel 3: 



poflttion filiod ifitb 



iMlly^^ualifiod ooraonnal 
(eofitinuod) 



Studont anroll- 
omit Cwithin 
guitelinaa for 
oiniouai/iMxinuM 
taocbar-fNipIl 
ratios) 



Studont oliftibility 
crltario 

Stata prog roMins 
policias and prior- 
itioa 



teta quMtims to Ba 
Jtoaiiorod at SKA/LM Urol 

H0T8: Undarlina dmotea 
broakouts for data 
collactloo 

CRafor to Cb,iy, Tablo 10) 



For this poiitiwi, 
is tiM 

c*)--fwci«ua ollomblo 
taMtiar-^iplX ratio 
(official stata guide^ 
llnaa)T 

C*>— actMl toachor-pupil 
ratio? 

Xnforantira m tbaao 
variablaa is oiso iff^or- 
taat to consiter in 
intarprating data on 
HIKBS. 



Sxasq^ios of Mow tho Oato 
Hay Da Usoful for Torgati^ 

Rasourcaa for Parammi 
Prooara tiwi iwd j^ruitaont) 
MTS: fMtura ati^ioa will onplri- 
cally toot ttia data's util- 
ity for dac iaioHMklnK. 



(Altbougb otato guidaliMs for 
toactior-pi^il ratios ia a bay 
variabla ossociatod with NX8BS* 
it warrants a spacial study to 
dataraina wbattwr and how it will 
ba uaaful for staking decisions 
about paraomial proparatlfm 
programs . ) 



(«) Findings irm iha pilot study suggastad that tbasa data ara likaly to bo availabia froa LUs- 

{**) Findings froa ths pilot study suggastad that any effort to datoraino and intorprat currant and projoct dmand for parsonnal on a ntiioMi basis, 
using HIHM iWO HlUSy as a proay for ^mnd, will hsva to includa data on tha koy (**) irariabla associated with tho spocific "loval of 
deaand,** and snka that data cosq^rabla. 

(n**) The proxy for daaand tbat tha pilot ati^y axsainod was HXRBS/PO H1R8S* 
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Table 11 CcontlmmS) 



um^ml of P^Mnd 

SOTB: Eacli '*lttv«l'* is a Mararfi 
of • pioco of tfio local 
dansnd for fwrsonml. 

(Kofor to Ch. Ill, TabUa 4, 5, 6> 



Tho Proxy for Damand 
That Is Aiaoeiatod 
mtfi This Layal(>»^) 

(Kafor to Cb. III. 
Tabla 6) 



rtm Variabloa Ttiat 
Mr* Aaaoeiatad Uitb 

HIKK/ID HlttS M 
Thia Laval of PaMnd 
C8afar to Cb. Ill, 
Tabla 6} 



I^ta QuMtlMi To Ba 
toanarad ot SKU/UU U#wl 

■0TB: Iftidarlioa tenotM 
lM?«AluMits for data 
eollactim 

Ctefor to Oi.iy, Tabla 10) 



Bxanploa of How tho Dato 
my fia Uaafyl for Tariatlfii 

toMiircM for INraonnol 
Proporat ian Cand Kacruitwot) 
HOTS: rutura att^iea Mill oapiri- 
cally toat tfta data*a ulil- 
ity for daciaioiwa>inic._ 



Biciatinit po aition fillad 
with fully>ouallfiad 



An USA f Ilia an alraady axlating 
poaition with a fully-qualif iad 
individual, for i^tovar raaaon 
that position haa boon vacatad, il 
represonts a dasand for poraonnal. 



HIBB 



Quaationa about tho paraon 
hirad ara Itm two m for 
Laval 3 obow. 



C**) Taaehar •ttrlti<H) 
or tumovar 



I 

09 



Did tha vacant poait-'on 
ariaa froai 

(*)-*trmafar within dia- 

trict to a oofi-taaehiiis 
p^itiOR or to rogular 
aducotionf 

C^)~ratirMntt 

(*)--dMthr 

— tranafar out of dla- 
triet, but within 
apaclal oducationt 
— earoor chwigaf 



a Idantlf iaa '*toi«h'' araaa for 
ratainii^ spacial oducatlon ataff , 
which in turn aiay raquira iaq^rovad 
training progrwa (o*B.« aoro and 
dlffarant practiciaa oapwrianea). 

a Hi^ tranafar rata (o.s- • 
tha SB araa) aay Indicata a alack- 
aning 4aaand in that araa. 

a Sussovta araaa ^ra thara will ba 
a contimting daamnd for paraonnal. 



imat ara charactariatica of a Si^aata point at which tunnover 

oaraoM wh^ Yfcata poaltiwiat stabilisaa* a.s., aftar X yaara of 

— mgm aia« aftar T yaara of aanrica* 

— nuabar of yaara taught 

in tha apacialty araa a Shorn i^ra highaat attrition rata 

»-eartlfiratlon atatua ia la.g.. proirlaionally cartifiad 

*-aax paraona). 



(«) rindinga fron tha pilot atudy auggaatad that thaaa data ara likaly to ba aval labia froa LBAa. 

C*«) Findings froai tha pilot atudy auggaat. that any affort to dataralna aod intarprat currant and pro J act daftand for paraonnal on a nAMoyifl baala, 
using HIBBS im> HIBK) aa a proxy for dMand, will hava to inclu<to data on tha toy variabla aaaociatad with tha apacific laval of 
daaand," and naka that data co^rabla. 

(***) Tha proxy for demand that tha pilot rt4«ly axaalnad mmm HIBBS/M Ml BBS- 

li3 
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Table 11 (continued) 



hmwl of DtiiMmd 

HOTO: Bach *'l«v«l- U • waTOr* 
of ft piece of the local 
dwmd for ^rramel. 
{Refer to Ch. 111. Teblee 4. 5, 6) 



The Proxy for Denend 
Thai xn Assoc iai A 
With This UvalC^**) 

(Refer to Ch. Ill, 
Tahle 6) 



The variables That 
Umn AasMiatetf With 

NXRSS/RD HIRES At 
^is Lewi of DsMwd 
(Refer to Cb, III* 
Table 6) 



Date QiMSticme To Be 
togiiared a t the LRR Uwrel 

iOTl: thiferiine denotes 
iNrealio'its for data 
coD^ction 

(Refer to Ch lV- Teble 101 



laasiplee of How the Dele 
Hey Be Veeful Tarsetins 
ResiHirces for Fereoimel 
Preoarat ion Cand RecniitPWt) 
VOTS: Puture studiM will empiri- 
cally test the data's util- 
itT for de<r ^fftm^^f!R 



Level S; Kxistifia poeitioii filled 
with less-t hen-ettality 
perycmnel 

An LSA fills an exist ins poeition 
with a fully-qualified individual, HIRB 
but the district is lese-than- 
satisfied with the person's quality 
or coispetence to teach in that 
position. 

Itowever, data questions are 
imfaasible . Bo one hes yet 
proved widely accepted 
**quality indicators'* that 
could be applied to deter-- 
sine respects in tdiich a 
person was ill-pr^ared or 
othentiee im^le to ^rf ore 
satisfactorily in the 
grf^'^M^ftr PORitiOT for 
which he or she witf hired . 



Quelity of supply 
(appropriatmees of 
IHB training, individu- 
al coe^tence) 



Unlito Levels 3 and A, it 
is strictly the individuel 
in the position and not the 
nature of the position it- 
self that repreeents the 
dMand at this level. 



(*) Findinss frosi the pilot study susR«^sted that these data ere likely to be available from LSAe. 

using MIRRS CBO HIRBS) as e proxy for d«Mi^« will have to ineiuoe oats on cne asy t / 
d^nd/' and nwke that data coiq>arable. 

(•**) The pro)cy for demand that the pilot study exsAined was HIBKS/BO HIRBS. 

1:5 



VI. Rec OBngendat 1 ons 



The discussion and implications In Chapter V provided the context for the 
recoBoendatlons in this chapter. That context is important for readers to 
recall when they review and assess these recommendations. 

The recommendations are divided into two sets. The first set is for 
implementation now . In the study team's judgment, they respond to the federal 
program's mandate to target resources to the demand for personnel to be 
traini. "based on identified state, regional, and national shortages'* (the 
legislative language). 

The second set of recommendations Is for implementation over the longer 
term. They respond to the necessity for OSEP and the Division of Personnel 
Preparation (DPP) to understand personnel supply and demand in all its 
complexity. This understanding will improve OSEP's and DPP's ability to (1) 
Interpret data on personnel demand, (2) use the data appropriately for setting 
program priorities and focusing resources, and (3) justify funding decisions 
to officials in the Federal Government and td program constituents (e.g., 
personnel preparation providers, their professional organizations, SEAs). 

Recommendations to Implement Now 

Recommend ation »1 . Iteclde the level(s) of d emand that the federal program can 
' address and match data collection to this policy objective . 

To meet its legislative mandate, the Personnel Preparation Program must 
direct its resources to training in "areas of critical demand" to address 
current and emerging shortages of fully-qualified personnel «ho are available 
to provide education and related services to children and youth who are 
handicapped. The pilot study suggested that (1) "budgeted, unfilled vacancies" 
and (2) "positions filled with underqualif led personnel" represent the most 
critical, current demand for personnel in the nation's local school districts. 



-83- 1 1 6 



At a nlnlaua, then, the federal program should focus resources on the 
demand for specific types of personnel that these two Indicators represent . 
This recOTBendatlon Is also consistent with the federal program's desire to 
target resources In a manner consistent with local demand . 

Implementing this recommendation will require OSEP to consider the: 

• utility and rurrency of data now on hand at the federal levej. 
for developing national, regional, and state profiles of 
demand (e.g., at the minimum target range proposed above) 

• adequacy of current data collection and reporting forms that 
SEAs use to obtain Information from local districts and to 
relay data to the Federal Government 

For example, the 1982 requirement to report "positions needed" defined 
this statistic as a cranbination of budgeted, unfilled vacancies and positions 
filled by personnel who are not fully certified. To target as proposed above, 
the current reporting requirement should have separated these elements; (1) 
unfilled positions; (2) posltlous filled with uncertified personnel; (3) 
positions filled with not-fully-certlfied personnel. 

However, pilot study data suggested that, even with appropriate 
breakouts, these numbers are insufficient for Identifying local shortages. 
Additional, qualitative information is requ ired to determine the specific 
nature of the shortage, and whether or not it can be addressed by training. 
This additional information includes variables that affect local personnel 
planning and hiring decisions and the ability to meet the local demand for 
personnel. These variables include geographic location and economic 
incentives/disincentives (data relevant to demand that is represented by 
"budgeted, unfilled vacancies"); and certification practices, size and 
proximity of local supply of personnel, and programming policies and 
priorities (data relevant to demand that is represented by "positions 
filled with underquallfied personnel"). 

Of course, there is no guarantee that local districts will replace 
underquallfied personnel with fully-qualified applicants if they become 
available, or that newly-graduated and fully-qualified individuals will 
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actually enter the special education careers for which they are trained. 
These are exasples of wbiguitles on the desand side and the supply side, 
respectively* 



Finally, abandon or drastically reduce current reporting reguirepents of 
SEAs if these data arc not useful for targeting or for other OSEP purposes . 
If the data are useful* clarify for what; if soiae data are virtually useless 
or have narginal utility, drop those requirements, p-nding further study. 
(See ReccMBsendatlon #6.) 



Recoamecdatlon #2 . In the absence of useful data for predicting teacher 

supply and deaand in a national market, use inexpensive 
methods that obtain a quick fix on areas of current and 
emerging demand . 

A small-scale survey of a representative sample of local districts 
(LEAs), high-producing Institutions of higher education (IHEs), and states 
(SEAs) with good data and data systems might yield a profile of local, 
regional, and national demand for personnel that provides a view similar to 
that of large-scale, definitive, costly studies. Periodic surveys and pilot 
studies (such as this one) seem to be a feasible way to monitor supply and 
demand for special education personnel* 



For example: 

• The pilot study suggested that local special education decision- 
makers define their demand for personnel in terms of ntmbers 
and service needs of children. They can (1) identify the areas 
in which they are currently experiencing shortages, (2) indicate 
the magnitude or severity of a shortage, and (3) identify the 
nature of applicants* and staffs' deficiencies for meeting 
children's needs in the local service setting. 

• Telephone calls to a sample of high-producing ISEb representing 
states or regions of the country could determine what recruiters 
who contact them are looldng for. Learning that every graduate 
of a particular specialty area has three job offers, for 
example, would suggest that the specialty is in short supply 
relative to demand* 
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• SEAs with relatively sophisticated data systems , whose files 
retain links to each LEA, oay be able to produce wlthin-state 
regional profiles of current supply and demand for special 
education personnel, possibly with breakouts by category, 
specialty area, or handicapping condition. 

Data can be analyzed to obtain rough estioates by special education 
category of (1) the oagnitude, nature, and trends for service needs, (2) the 
demand for qualified personnel trained to meet those needs, and (3) "projected" 
shortages (from tine scries data). The analysis should Identify, to the extent 
possible, the service delivery needs that can be net through a training 
function. 

To detennlne the merits or drawbacks of this approach (or alternative 
options),* consider the following: 

• Does it provide information that 

- is useful for identifying shortage areas? 

- identifies the nature of children's needs for specific 
kinds of services? 

- suggests the nature of training required to qualify a 
person to provide those services? 

- is useful for defining and selecting priority areas for 
funding ("competition areas")? 

- is useful for apportioning funds among competition areas? 

- is useful for making grant award decisions? 

• Is the effort worth the time and cost? 

• Is it acceptable to program officials? to those to whom 
they are accountable? to program constituents? 

• To what extent is the information objective, verifiable, and 
reliable? 



« A useful discussion of criteria for evaluating options for information 
systems is in "The Development of An Information System to Identify 
Rehabilitation Personnel Shortages: Suggested Options" (Hastings, Hayward, & 
LeBlanc, 1984). 
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Inplcment this reconaendation in collaboration with the recently funded 
Clearinghouse on Careers and Eaployaeot In Special^ Education . The Clearing- 
house Is developing and field testing promising aethods for gathering good 
data to use for estiaatlng current and projected personnel shortages. 

Recoaanendatlon #3. Plan data collection la collaboration with SEAS, 
LEAs, IHEs, and major professional organizations . 

Whenever federal requirements call for new or modified data collection, 
develop plans In collaboration with SEAs that have good data systems 
(including CSPD), and with expert representatives from LEAs, IHEs, and major 
national professional organizations and their task forces and committees 
(e.g., NASDSE, CEC, HE(SE, ASHA). 

Representatives of the first two groups (SEAs and LEAs) participated in 
this pilot study and provided Insights for interpreting personnel data and for 
building a good data system. Representatives of the last two groups (two 
consultants who were formally and informally associated with IHEs and major 
national professional organizations) commented on the design for the pilot 
study and reviewed a draft of the present report. All of these individuals 
share credit for the list of specific suggestions that follows. 

For new data collection, work with SEA/LEA representatives to 
a^ree on ; 

• questions to be answered by the data . (This will ensure that 
data address questions of interest to SEAs and LEAs and will 
provide national, regional, and state-l^-etate information 
that is of use at federal, state, and local levels.) 

• how to design/modify data collection forms. (The reporting 
format should serve a variety of purposes.) 

• amount of lead time that SEAs and LEAs need to prepare for 
data collection 

• availability and costs of oV.:ainlng useful data 

• feasibility of obtaining data or other information that may be 
related to "unrevealed" demand—demand that is not apparent 
from only the counting and reporting of numbers. Relevant 
data and information Include certification practices, status 



-87- 

ERIC 



of child-find activity, enrollaent caps on certain handicap- 
ping conditions, oaziBUo teacher-pupil ratios vs. actual 
teacher-pupil ratios (by handicapping condition or area), 
grouping for instruction, demographic factors, and recruitoent 
difficulties. 

• olnialzlng burden at the school building level. (Otherwise, 
the data collection could hinder the efforts of local 
personnel to provide adequate special education and related 
services to students*} 

• nature, fom, and delivery of technical assistance In how to 
fill out new foras 

During the above planning process, obtain feedback iroa the supply 
side — representatives of IHEs and professional organizations » which represent 
important constituencies for the federal program. The purpose of Involving 
then Is to decide whether the data to be reported, the distinctions in 
reporting it, and the questions to be answered can tell IHEs anything that 
will help theo to; 

• Improve their personnel preparation programs 

• decide i^ether they need to cut back programs in some areas 
and build up programs in other areas 

• Improve and focus recruitment and incentives 

For example, distinguishing between new and existing positions, and among 
sources of hires, conceivably will help IHEs market to different groups of 
prospective students, and would aid their decisionmaking In modifying and 
scheduling their offerings. 

In addition, ask IHEs whether or not they use such data in their attempts 
to estimate demand for personnel as a basis for program planning. Obtain 
their reasons for using different kinds of data. Obtain their perspectives on 
the utility of the data given the variations across school districts. 

Finally, administer future data collection through a state's CSPD 
"operation." However, the success of the effort will depend on federal 
leadership — support, encouragement, and technical assistance. 
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RecomBcndatlon #4. Conduct feasibility studies of statistica l means for 

iaproving the utility of available data . 



Such studies could be modest but very creative efforts, subject to 
validation in a larger future study. For exaaple, the aualysis of sample data 
in this report demonstrates the feasibility of a "ratio estimation" method to 
produce national estliMtes of demand. 

Examples of additional feasibility studies of statistical manlptilatlons 
of data include; 

• ways of adjusting certain data elemeiits to correct for known 
tendencies toward over- or underestimation of demand 

• ways of makii:^ data ccraparable for use in making national, 
regional, and statewide estimates of demand to identify 
critical areas of shortage 

• developing a series of ratio and difference measures which 
considered Jointly could describe a district's special 
education staffing situation 

• how far into the future projections cm* be made that provide 
useful data for targeting and for long-range planning 



Reco mmendation #5. Agree on definitions of terms that t he Federal Government 

• uses in statements about targeting critical areas of 

dem.^fld for personrel . 

In this pilot study, these were relevant definitions: 

demand In the economic sense of "supply and demand," the 
quantity of a commodity or service wanted at a 

specified price and time, e.g., services provided by 

special education personnel 

In special education, demand for personnel is driven 
by enrollments (numbers of special education 
students and their handicapping conditions), and by 
the amount of federal funding (PL 94-142) that 
reaches the local district. 

In the pilot study, "demand" was equivalent to the 
"need to hire." In turn, the need to hire (and the 
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outcomes of the hiring process) were associated with 
five levels of deaand: 



Level 1: Budgeted, unfilled positions 



Level 


2: 


Positions zillea out witn unaer~ 
qualified personnel 


Level 


3j 


New positions filled with fully- 
qualified personnel 


Level 


4: 


Existing positions filled with fully- 
qualified personnel 


Level 


5: 


Existing positions filled with fully- 



qualified but lesb-than-quality 
personnel (qualitative issue of a 
certified individual's teaching 
competence) 



need the requirements of children and youth for special 

education and related services 



The pilot study avoided using "need" as a synonym 
for "demand." It distinguished between the need for 
services (by those irtio are handicapped) and the 
demand for personnel (the need to hire). 

shortages budgeted, unfilled positions for special education 

and related services personnel 

In the pilot study, SEAs and LEAs extended this 
definition of "shortages" to include positions 
filled with personnel who were underquallfied 
(uncertified or not fully certified). The LEAs 
extended it even further to include categories of 
personnel who were difficult to recruit (hard to 
find, in limited supply). 

supply Che quantity of a commodity or service offered for 

sale at a specified price and time, e.g., services 
provided by special education personnel 

In special education, the supply of personnel within 
a state comes fron four major pools: 

(1) new teachers (college graduates, including 
newly-certified teachers) 

(2) former teachers (re-entering special education 
careers) 
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(3) continuing teachers 



NO HIRE 



(4) out-of-state teachers 

HIRE a vacancy in a position, lAich is filled with 

personnel as a result of the local planning and 
hiring process 

In the pilot study, HIRE(S) as a single measure was 
not an accurate estisate of demand, but rather a 
craposite of several oieasures, each of i^ich had to 
be ezasined separately* Each component measure t in 
turn, vas associated with variables that required 
examination. (For example, the craiponent measure of 
"positionCs) filled with underqualifled personnel" 
requires that the associated variable of "state 
certification practices" be examined.) 

a vacancy in a position, i*lch remains unfilled as a 
result of the lt)cal planning and hiring process 

a budgeted, unfilled position representing a 
critical demand for personnel 

the demand for personnel that is apparent from the 
counting of budgeted vacancies, current staffing 
levels by category 

the demand for personnel that is not apparent from 
such counts 

An example of unrevealed demand Is using unduplicated 
vs. duplicated counts of students and their primary/ 
secondary handicapping conditions to determine the 
number of personnel required to provide services. 

Use the agreed upon terms consistently in data collection forms , grant 
announcements, internal plannitg documents, program regulations, and public 
statements. For example, the 1982 regulations ask SEAs to report additional 
positions "needed" for the current reporting year, and instruct SEAs to 
include in that figure "positions open but not filled" and "positions filled 
with uncertified personnel." As worded, the request obscures concepts and 
data elements that the above definitions clarify. 



revealed 
demand 



unrevealed 
demand 
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Rcconnendatiops to lapleaent Over the Longer Term 



Recomneodfltlou #6 . Work closely with the nev Clearinghouse,* and support new 
" studies when appropriate, to systeaatlcally build a 

coaprehenslYe data base that is useful for targeting 
current and emerging deaand for personnel * 

This is a long-term investment in information that could improve OSEP'a 
and DPP's understanding of (and access to information about) factors that 
influence the magnitude and nature of demand . Understanding bow these 
imvortant factors affect the balance of the supply-demand equation will help 
OSEP and DPP to: (1) interpret and use data on demand for targeting federal 
training resources, and (2) provide documentation of their decisions to 
officials in the Federal Government and to program constituents In the 
personnel preparation system. (These are assumptions to verify empirically.) 

The key elements of this recommendation are: 

• an organizing framework 

• a coordinated approach 

• an active working relationship with the Clearinghouse on 
Careers and aaployment in Special Education 

9 Information gaps that call for collaboration now 

An organizing framework . Table 11, at the end of the preceding chapter, 
offers a possible framework for systematically gathering Information and 
augmenting a database on personnel demand in special education. It provides a 
structure and logic which build on the pilot study's analysis of the local 
personnel planning and hiring process and its outcomes (th. HIRES model and 
its associated variables). 



* The 1986 amendments to the Education of the Handicapped Act established a 
national Clearinghouse on Careers and Employment in Special Education. Its 
broad purpose is to organize, assess, disseminate, and prraaote the use of 
timely, reliable Information that pertains to career choice, conditions of 
employment, and identified needs for special education and related services 
personnel. The major groups of institutional clients are local and state 
education agencies (LEAs, SEAs) and institutions of higher education (IHEs). 
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A fraoeworli should also be developed for examlniag personnel supply . 
(The new Clearinghouse may be doing that.) 

A coordinated approach . Conducting further studies depends upon answers 
to questions such as those the Clearinghouse will consider as it organizes and 
assesses the quality and utility of existing inforuation on personnel supply 
and demand: What is already known? Is it useful for identifying current and 
emerging shortages? Can deficiencies in the Information be remedied through 
existing data collection and reporting mechanisms, or Is a new study the best 
strategy for improving the data? What are prraaising sources for the desired 
dat£i 

Answers to these questions will suggest appropriate next steps, which are 
apt to include more than one approach . Thus, it makes sense for OSEP, DPP, 
and the Clearinghouse to coordinate future quests for data. 

An active working relationship between OSEP /OFF and the Clearinghouse * 
Officially, DPP is responsible for administering the Clearinghouse contract. 
However, a formal agre »ent of the working relationship might establish the 
federal program as an i> >ortant client , one which stands to benefit from the 
database and expertise the Clearinghouse will develop. 

Information gaps that call for collaboration NOW , A working relationship 
is oest exemplified by collaborating to address critical information needs , 
such as: 

• the nature and variation among states* certification require- 
nents. The Clearinghouse may already have obtained this 
existing information from the Council for Exceptional Children 
(CEC) and other sources. 

• the nature of the supply side of the supply-demand equation. 
Information gaps include the sources of supply} the size and 
characteristics of these pools; the probability that members 
of each pool enter careers in special education for which they 
were trained; whether current trainees are new or continuing 
teachers; the certification status and attrition/ turnover 
rates for special education teachers who are currently 
employed special education teachers; relationships among 
factors such as certification status and attrition, age and 
attrition, and so forth. 
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• forecasting aodela . One oajor problem of existing aodels is 
the Inability to represent the effects of market aechanisas 
that say be ispleaented to offset shortages and tight budgets, 
e.g., exceed desired class sizes; allow less-than'fully 
certified personnel to fill slots; modify programs (Olson & 
Rodman, 1987). Another serious problem for model builders Is 
providing the lead time the personnel preparation system 
requires tc design and test training models that equip 
personnel to provide quality services — plus the years it takes 
for trainees to graduate. 

Further cnnside rations . Future research and Information on personnel 
demand must also account fo?.- the following, in addition to the data and 
Information that Table 11 Inrlvies: 

• funding and enrollments . This raport has emphasized the 
overriding importance of these two variables In shaping the 
number and nature of available positions (filled and unfilled). 

• the base number of positions (filled and unfilled) . This 
vonld tell the Personnel Preparation Program iand IHEs) the 
size of the carket, where the jobs are, and how they are 
tbanging, 

• a regular education baseline . Educating policymakers about 
areas of critical demand for special education personnel will 
be easier if they can cocpare that data against similar 
Information for education in general. For example, math and 
science are two areas of regular education widely acknowledged 
to be suffering severe shortages of fully-qualified teachers. 
However, comparable data for special education reveal 
dramatically greater shortages for certain categorical areas 
(Lanritzen, 1986). 

Whatever focus a new study might take, any data collection should include 
both LEAs and SEAs . As the pilot study uemtiistrsted inquiry at the local 
level helped to get beneath the numbers apd labels, to clarify concepts and 
terminology, and to reveal the hows aiiu v*\ys. But Inquiry at the SEA level is 
also essential. 



For example, SEA data linked tc individual LEAs may be available for 
analysis, and for comparison with data obtained from LEAs in the study. For 
the study conponent that focuses on Level 2 Jemand (positions filled, but with 
underqualifled staff). Inquiry at the SEA level is Important because state 
guidelines and requirements obviously affect local programming, personnel 
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planning and hiring} and staffing practices. What do Individual states allow 
with regard to placing personnel who are underquallfled in classro(»is7 What 
is the range of definitions across the states for personnel who are under- 
qualified? Vhat prograsBDlng policies are connected with policymaking and 
underquallfled personnel? Inquiry at the SEA level will enable cross-state 
coioparisons regarding certification practices, definitions i policies. 

Collecting data by categorical area is also important . To examine 
personnel demand in states that are noncategorical will require special 
consideration. For example* a study of state certification practices might 
obtain data on qualifications of teachers and data on the types of students 
they are teaching. 



Recommendation #7 . Seek a viable and acceptable way to base estimates of 

personnel demand on the needs of children and youth for 
si^cial education and related services . 

This recommendation could be Implemented as part of Recommendation #2 
("small-scale surveys and pilot studies"); it is intended to supplement 
existing sources of information.* Following is the rationale for doing so. 

The federal program wants to support the preparation of personnel to meet 
demand at the local level* and to establish priorities based on actual needs 
of the field. Therefore, a targeting strategy to accomplish this must be 
based on data and information that express the magnitude aod nature of that 
local demand. 

The pilot study suggested that local districts define their demand for 
personnel this way: "teachers with certain qualifications and competencies 



* The federal program solicits advice from knowledgeable professionals in the 
field prior to defining annual priorities, and requires "needs statements" 
and supporting dociirontation in grant applications to Justify grant support. 
The federal program has relied to a large extent on experts* and grant 
applic&its' assessments of persotmel demand in the absence other useful and 
widely accepted data. (Neither states' (SPD plans nor statistics in their 
annual data reports have been adequate for this purpose.) 
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who can meet the particular configuration of children's needs that defines the 
position they are being hired to fill." 

This very ioportant qualitative inforaation was masked by statistics such 
as those the pilot study produced, which were based on numbers of budgeted 
vacancies that were filled or not filled, and on numbers of qualified or 
underquallf led "hires." 

Being able to estimate the number of NO HIRFS and HIRES does not reveal 
enough about children's service needs to suggest a focus for federal training 
funds (i.e., the kinds of training and training models that might produce 
graduates with the desiired qualifications ). 



The study team recognizes that implementing some of the above 
recommendations will entail a selling job for OSEP with its constituencies 
(IHEs, SEAs, major professional organizations which Influence the field), and 
within the Department of Education. The next chapter discusses points that 
may be raised when debates occur, and Identifies positions that OSEP may or 
may not wish to take regarding the federal role* 



ERIC 



-96- 

129 



VII. Further Considerations 



This chapter presents considerations that reflect discussions with the 
work group and the two consultants for the strategy evaluation, with 8<»>e of 
the intervleirees In the pilot study, and among oeohers of the study teas. The 
purpose of including this In a closing chapter to the final report Is to focus 
further discussion among OSEP staff as they consider how best to implement 
recommendations from the strategy evaluation. 

Should OSEP Bypass SEAs to Obtain Data? 

SEAs in the pilot study and experts who have studied personnel supply and 
demand in special education acknowledge that personnel data collection has not 
been a high priority in any state. They also cosBsent that the great variation 
In how states collect data presents problems for obtaining useful Information 
through SEA channels for a national (central) data system. 

Without proposing an "SEA-bypass" alternative, earlier chapters described 
a restricted set of data (HIRES/NO HIRES and certain other variables) that 
were likely to be available from LEAs. Local decisionmakers used the 
Information to determine the need to hire special education personnel. SEAs 
used the LEA data and other information selectively to answer questions of 
importance to the SEA or the legislature < Although some of the data elements 
had originally been linked to individual LEAs and even to individuals, there 
was no way for parties outside the SEA to access the original Clinked) data 
files directly by computer, nor to purchase files for independent analysis. 

SEAs that participated In the pilot study had been chosen because they 
represented "the best" among those SEAs reputed to know how to develop and 
malntF.ln good data systems for analysing personnel supply and demand. They 
had become extremely proficient In designing data collection forms and 
procedures that yielded close to lOOZ response rates and accurate LEA 
reporting. They had developed strong credibility with their LEAs by providing 
useful feedback and assistance. 
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For any special data collection that bypasses the SEA, especially In 
states where SEAs have established credibility with LEAs, it will be vital to 
Involve SEA staff in promoting the effort. But it aay be unrealistic to 
expect SEAs to support such an effort wholeheartedly, with the enthusiasm and 
coDBitment that can make their own data collection efforts successful. 



From What Level Should Targeting of Federal RcwLmrces Be Pursued? 

Whatever position OSEP takes on this question oust have a rationale, that 
is, an underlying logic consistent with the goals and objectives of the 
Personnel Preparation Program. 



The goal evaluation documented the rationale for a federal role in 
personnel preparation, and articulated the program's logic (Campeau, et al. , 
op. clt.). The following overview of these logical antecedents and 
underpinnings is Included here in abbreviated form to provide a context for 
considering the present question. 

Why is there a Personnel Prepsratlon Program at all? Why not 
leave universities, states, and local education agencies (LEAs), 
or others entirely to their own devices to train personnel to 
provide education and related services to childrec and youth who 
are handicapped? 

The reasoning proceeds that these children will not have an 
opportunity to achieve their full potential tmless three 
conditions are mets (1) there are sufficient numbers of 
qualified personnel specially trained to provide then the 
benefits of effective and appropriate education; (2) the quality 
of such specialised personnel is sufficient; and (3) the system 
for personnel development has the capacity to meet the demands 
for both quantity and quality of specially-trained i^rsoimel. 

If left to its own devices, the reasoning goes, the system will 
not attain these three alms in a timely fashion nor in a compre- 
hensive enough manner without external stimuli. In short, the 
appropriate role for the Federal Government is a catalytic one. 

For example* the Federal Government is in a uniquely advantageous 
position to: highlight priorities of national concern; muster 
resources and Information on behalf of the system as a whole; 
provide a national perspective on current and emerging needs (st 
all levels) for particular types of specialized personnel, model 
programs, curricula, etc.; Identify and encourage replication of 
state-of-the-art practices in personnel preparation; and maintain 
national visibility for special education personnel development 
(all levels). 
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The ultlaate beneficiaries of the Federal Goverosent's Investment 
In T^rsonnel preparation programs are children and youth who are 
handicapped. On their behalf, the prograo holds itself 
accountable for three objectiyes: (1) produce sore qualified 
personnel, (2) laprove the quality of personnel trained, and 
(3) expand the capacity of the system for personnel development. 

In the goal evaluation, the work group identified eight major strategies 
that the Personnel Preparation Program uses to achieve these objectives. One 
strategy is targeting federal program resources to critical areas of demand 
for personnel , both current and future . This strategy is directed at the 
first program objective: "to produce more qualified personnel." The 
rationale is that directing program resources to personnel preparation efforts 
in arees of critical demand will make available more of these types of 
qtialified personnel. 

Up until now, this targeting strategy has been orchestrated from the 
federal level through grants from the Personnel Preparation Program. Nearly 
all grantees are Institutions of higher education (IHEs) or state education 
agencies (SEAs), but mainly IHEs (the supply side of the personnel supply/ 
demand equation). This presents the federal program with the following 
challenge for implementing its targeting strategy: target resources to meet 
local demand for fully-qualified personnel when the vehicle for doing this is 
a su pply-side grant program. 

A variety of activities that OSEP divisions administer, including certain 
grants from the Personnel Preparation Program in the Pivision for Personnel 
Preparation, seek to build states* capacity to identify and meet their own 
needs for special education and related services personnel . Findings and 
conclusions from the pilot study suggest that, while this may be a plausible 
strategy for defining and addressing current demand for various kinds of 
personnel and service delivery apprc^ches, it is questionable whether such a 
strategy will work for ii»eting projected demand . 

The plausibility issues include: 

• difficulties like those the SEAs in the pilot study experienced 
in attempting to forecast demand for specific kinds of personnel 
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the unknown nature of new or future sodels for Improved service 
delivery that IHEs will pioneer 



• uncertainty that SEAs can exert sufficient leverage on IHEs to 
direct their R&D efforts to areas of demand for personnel trained 
in particular ways and for particular types of service delivery 

• lack of capacity and resources of SEAs and LEAs for conducting 
R&D that is national in scope and concern, or for designing and 
testing Bodels in a cosprehensive way 

• scarcity or total absence of special education leadership 
personnel in SEAs 

• severe resource problens that SEAs and LEAs experience as a 
result of competition for scarce ftmds, and shifting or 
conflicting priorities for serving students 

What this suggests is consistent with observations fros the earlier goal 
evaluation phase. These observations were that the Federal Government is in a 
uniquely advantageous position to use its considerable resources and capacity to: 

• conduct research that is national in scope, concern, and 
consequence 

• ensure that model program dissemination is national in scope 
and impact 

• stimulate IHEs to address a national personnel preparation 
agenda in Innovative ways, and to lead the field 

• support personnel preparation programs that do not attract suf- 
ficient number B of individiials to justify their costs to IHEs. 
(This is especially true for emerging roles in special education 
and for specialities that address unique needs of relatively 
small subgroups of the population of children and youth who are 
handicapped.) 

• support IHEs* efforts to attract, retain, and graduate adequate 
numbers and types of doctoral and postdoctoral leadership 
personnel, who will promote state-of-the-art practice in 
personnel preparation at all levels 

• stimulate IHEs to promote institutional change within their own 
boundaries. (Too often, educational institutions become rigid 
and inbred, losing sight of the practical realities of the 
field.) 
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In other vords* an argument can be aade that IHEs are where leadership 
personnel and Innovators are most likely to reside > and where capacity lies, 
given a boost of federal funding through grants from the Personnel Preparation 
Program. Quality and leadership among IH£ personnel will affect the quality 
and characteristics of the overall supply of personnel In special education* 

This argument also acknowledges that the federal level exerts significant 
leverage on the field by setting priorities and directing resources in ways 
that Influence system priorities. 
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EXECUTIVB SUIQIARY 



This sussnary hishllghts findings and conclusions of a goal evaluation of 
the Personnel Preparation Program, administered by the Division of Personnel 
Preparation (PPP), one of five divisions in the Office of Special Education 
Prograns (OSBP) in the U.S. Departs»nt of Education's Office of Special Educa- 
tion and Rehabilitative Services (OSEBS). 



Overviev of the Personnel Preparation Proitram 

The program «ras authorized in 1970 under Part D of the Education of the 
Handicapped Act (P.L. ^«-230), although the history of federal involv«»nt in 
the preparation of personnel to work with the handicapp«^ goes back nearly 30 
years . 

The present program, lihieh is the largest of the discretionary programs 
in OSEP, has cvceived total appropriations of over $800 million since 1966 for 
the purpose of increasing the number of fully qualified persons that are 
available to provide education and related services to handicapped cTia.idren 
and youth. Appropriations exceeded $60 million each year in FYSS and Fy86, 
and the authorized funding level for FYS? exceeds $70 million. 

The Personnel Preparation Program awards grants that may be renewed 
annually for up to five years (three years, generally). Grantees may be 
institutions of higher education (IHBs), state education agencies (SSAs), or 
other appropriate nonprofit organizations, who may use their funds in these 
major ways: to develop, in^rove, and support personnel preparation programs 
(and to provide financial assistance to participants in these programs)! to 
develop, evaluate, and disseminate models with broad significance for the 
field of personnel preparation; and to provide technical assistance and 
information to training providers, including parent organisations, so that 
they will be able to meet effectively the needs of children and youth for 
specialized educational and related services, and to interact effectively with 
the system on their behalf. 
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In FY86« OSSRS announced 10 priorities for cos^etition: (1) preparation 
of special educators; (2) preparation of related services personnel; (3) 
parent orgsjiizatlon projects; (4) preparation of personnel to provide special 
education and related services to newborn and infant handicapped children: (5) 
preparation of leadership personnel; (6> si»ecial projects; (7) state education 
agency (SBA) projects; (8) preparation of personnel to liork in rural areas; 
(9) preparation of personnel for minority handicapped children; and (10) 
regular educators. Hot all published priorities need be announced for new 
grant cooqpetition each year; for exan^le, the "transition** priority was not 
announced for new grant competition for Fy86. 



Overview of the Coal Bvaluation Process 

The goal evaluation had three purposes. One purpose was to determine the 
degree to which those strategies the f^eral program intends to pursue through 
the above major types of grant activities are actually being isqplmented by 
grantees. The second purpose was to determine, to the extent that data avail- 
able to the study team permitted, if the Personnel Preparation Program is 
achieving its objectives. Third, the goal evaluation developed infonmtion to 
show if funded activities can logically and plausibly produce the mitcoros 
desired by the program, even if actual evidence of these outcomes is insuffic- 
ient. 

The goal evaluation process drew heavily on the assistance of OSSP staff 
and management. Thrmighout, thm task leader met with a work group coovosed of 
managers and staff r^resenting the program, OSBP, and Office of Planning, 
Budget, and Bvaluation (OPBB). They helped to develop some of the study's 
products, and reviewed and critiqued others. Their knowledge of the Personnel 
Preparation Program and its policy context, and the time they invested to make 
sure that this collective effort stayed on track, were essential to the 
pertinence and utility of tt» goal evaluation process. 

The evaluation approach consists of two parts: a goal evaluation and a 
strategy evaluation. This sunnary pertains to the goal-oriented phase of the 
evaluation, ndiich is now ctti^lete. 
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Th* main st«p8 in thn iq aI eva luation included; (1) documenting the 
program's logic and underlying assua^tions; (2) conducting pro jest reviews of 
a representative sample of 57 projects, with data collection aq^hasizing d<ipth 
in areas important for a program analysis of this type; (3> analyzing program 
iiq>lementation, performance, and plausibility; and (4) drawing conclusions and 
framing recommendations for program management, OSBP, and the work group to 
review in preparation for planning the second, strategy-oriented phase of the 
evaluation. 

Proaram Ob<ectives and Loitic 

The work group reached a consensus on the following stat«nent of the 
Personnel Preparation Program's ultimate goal and objectives: 

in»4iii ^fr« f ^ i^i^i : To enhance education and 
related services for handicapped children 
and youth through the preparation of 
specialized personnel 

"Specialized personnel" means anx personnel, including regular educators, 
who have the knowledge and skills necessary to deliver such services to this 
broad target group. Using the word "enhance" deliberately iaqjlies that (1) 
fully achieving "free and appropriate public education" for handicapped indi- 
viduals is beyond the direct control or resources of the f<»deral government 
and, in turn, the program and that (2) appropriate roles for the program are 
complementary and catalytic ones. 

To achieve its ultimate goal within these two caveats and those in the 
authorizing l^islation and regulations, the Personnel Preparation Program 
directs its efforts to three enabling objectives: 

0 To produce more qualified persoimel to serve children and youth 
who are handicapped 

9 To <««prq Y^ qiifHtv of personnel trained to serve children 
and youth who are handicapped 

e To es^md .^tw_capacity of the system for personnel development 
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The Personnel Preparation Prosram utilizes eight major strategies to 
attain these three objectives: 

1. Supporting recruitment and retention 
Z. Targeting critical needs 

3. Supporting siodel program deveJopnent, evaluation, and dissemin- 
ation 

4. Supporting leardership develoi»i»nt 

5. Encouraging state and professional standards 

6 . Supporting parent organization projects 

7. Building capacity 

B. Promoting institutionalization 

Figure 1 portrays the logic of the overall program. It shews the rela- 
tionships among events that influence program design, ifl^leasentation, and 
capacity to meet these objectives. Figure 2 shows the relationship among 
federal strategies, grant activities, and program objectives. The causal 
assufl^tions inq^lied by the tw> figures are made explicit in the full report of 
the goal evaluation. 



These major points are relevant to the Figures 1 and 2: 

e The Personnel Pcvparation Program pursues particular strateKies 
through activities that gctmteas carry out at the state, 
institutional, and local level. (These strategies and activities 
are the row and column labels, respectively, in Figure 2.) 

e Thus, the grant programs are t)m primary mechanism for implcenmnt- 
ing federal strategies and legislative intent. 

e The matrix conveys the expectation that, in aggregate, (1) 
projects in a particular priority area will contribute nwra to 
one program objective than to the other two, and that (2> the 
means they i^^leoMnt will be congruent with the faderal 
strategy(ies) that are "attached** to that objective. 

e It is possible to focus grant cMq^titions (for selected 

priorities) to accommodate one or more of the strategies (and 
program objectives). 
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POLICY lUPUTS 



PEOCMM IHPUTS 
(by WP) 



USING SEVERAL 
FEDERAL STMTECIES 



THRSW^ CRMT 
FgOCRAH ACTIVITIES 



TO ACHIEVE 
PROGRAM OBJECTIVES I 



THAT CWTRIBUTE TO THE 
ULTIHATE PROGRAM (k)AL 



• EMbling legl»la- 
lion 

P.L. 9a-l99pPartD 

• Regulations 

34 CFR» Part 318 

• Appropriations 
$6I»2M>,000 (FYU) 

Eitecutivc Agenciea 

• Adttiniatratioo 

policy directives 

m policy direc- 
tives 

m EO policies 

e OSERS priorities 

The Field (Consti - 
tuencies) 

s Needs anaXy aes, 
data 

s Priority sugges* 
tions 

• Peer review 
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Prograa support 
Grant prograa adsinistration 



• C5PD support 



Leadership snd technical 
assistance to the field of 
peraonnel pweparatiim 
(all levels* as feasible) 

Coordination and collabora* 
tion with other agencies 
regarding personnel pre- 
paration 



^ Supporting recruit- 
sent and retention 

(2^ Targeting critical 
needs 

Support iiig wdel 
progrM devslofHuent, 
evaluation, and 
diaseminatlon 

^ Supporting leader- 
ship development 

Encouraging state 
said professional 
Btsndards 

(6) Supporting parent 
organixat ion 
projects 

(7) Building capacity 

(s) Pnwting institu- 
tionallcation 



Prograa develop- 
■ent » laprovewnt , 
and support, in- 
cluding stipends 

Itodel prograa 
develofwnt, 
evaluations -ind 
dissemination 

Technical ass is* 
tance and infor- 
mation 



m Produce more 
qualified 
persoimel to 
serve children 
and youth who 
are handicapped 

a iim>rovtt Che qual- 
ity of personnel 
trained to serve 
children and youth 
who are handi- 
capped 

s Expand the capac- 
ity of the system 
for personnel 
development 



nOTZ; Figure 2 shows che relationship aiwng strategi^is, 
activities, and objectives. 



Alliance education 
and related services 
for handicapped 
children and youth 
through the prepara- 
tion of specializtfd 
personnel 
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Figure 1 . 



Personnel Preparation Program Logic Model 



PSOOAH OBJEimVES/ 
FEDEiAL STRATEGIES 


Prograa Development » 
I»provettent» and Support, 
Including StiiWMla 


CSANT ACTIVITIES 

Hodel DevelopMBC. 
Evaluation, and 
Dloaaalnation 


Technical Assis- 
tance and 
Infonation 


Produce more qualified 
personnel • • • 

(1) Supporting recruitment and 
retention 

(2) Targeting critical needs 
areas 


Special Educators Q 
Kelated Services w O 
Rural 9 
Infant (D CP 
Transition 1 ® O 
Hinorlty 1^ (j> O 






Improve the quality of 
personnel • • • 

Supporting Bodel prograa 
^ developnentv evaluation, 
< and disaeftlnaCion 

^4) Supporting leadership 
developient 

Encouraging state and pro- 
fessional standards 


Leadership Projects (S) 


Special Projects G 




Expand the capacity of 
the system for personnel 
developsnent » • • 

(b) Supporting parent organiza- 
tion projects 

14 B Supporting inproveoients in 
systM capacity 

(b) Promoting Institutionalization 


Regular Edtwators ^ 
SEA Projecta O 




Parent Organization . 
Projects Q ^ 
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Figure 2. The Intended Relationship Aaong Progran Objectives, Federal Strategies, 
Grant Activities, and Priawry Foci ol Coapecltions (FY86) 



• The assftntial eor* of grantraaking activity is rap resented by 
ttia fiva elustart of priaary activity dapietad in Pigura 2 
(sea Bc»nan numerals in fiva calls). 

a Call entrias indicate tha main oflpliasis of Fy86 grant 
activity. Thasa clusters migtit be consitutad differently, 
depandins upon how each coapatition area is defined for a 
particular fiscal year. 

The (above) gross classification sch«ra that Figures 1 and 2 provide 
served two purposes in the goal evaluation. One was to ahow the Personnel 
Preparation Program's overall strategic plan, i^re tha federal investment in 
grarts is intended to generate the most mileage toward one of the three 
objectives. (The work group realized that projects will implement strategies 
in addition to those shown as their primary en^hasis in Figure 2.) The second 
purpose of the classification scheme was to provide the conceptual underpin- 
nings for planning data collection and analyses. 



Data Collection Approach and Related Caveats 

The study team carried out 57 confidential project reviews, in Which the 
primary data sources ware information in grant files and 75-ninute (average) 
. focuied telephone interviews with project directors and/or principal investi- 
j^«(ors. (One project was dropped twcause available information «ras too minimal 
to include it in subsequent analyses.) 

The study san^le consisted of subsamples dratm from each of the program's 
priority areas, shown as call entries in Figure 2. For the most part, projects 
trare drawn at random frinn Fy86 continuations whose initial year for their 
current grant was Fy84. 

Restricting data collection to currently operating projects, mt of 
which began in Fy84, ensured that thay had been running long enough to have 
learned lessons from their impleiBentation experience that would be very infor- 
mative for a program analysis of tha type conducted in a goal evaluation. 
Also, batter cooperation was expected froa project staff trtiosa projects were 
currently operating than from projects that had baen cmpletad or discontinued. 
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On tiM other hand, data collection from "live** projects necessarily restricted 
the study to conclusions on prospective program performance supported by 
evidence that grantees said they were collecting or were likely to present in 
their final performance reports. 



These additional caveats apply to conclusions frcMB the go-^l evaluation: 

e It is not within the scope of a goal evaluation to collect 
primary data on project acco^lisbmenta, or to capture all 
relevant perspectives. Project reviews rely on two major 
secondary data sources: initial and continuation applications 
in grant files, and interviews with project directors or 
principal investigators. Althoi^h Interviews were conducted on 
a confidential basis, and most interviewees semed to be 
candid, it is possible that aotm relevant information was not 
coaammicated. 

e Evaluation resmirces for the goal evaluation did not permit 
data collection from third parties, such as consua»rs (agencies 
who subsequently utilize the personnel trained and tlMi owdels 
or programs developed through grant activities). They could 
have indicated the esctent to tdiich these products are meeting 
their critical needs and are found to be high-<|uality, useful, 
and effective. 

e The goal evaluation saBq>le is amaXl in proportion to the size 
of the program, although it is ropresentative of t\m broad 
array of Personnel Preparation Program grant activities, and 
six of the eleven subsaiq>les constituted bettraen 25% and 37% of 
their saa9>ling pools. 

e Conclusions pertain specifically to federal strategies es the 
Personnel Preparation Program perceived th«n, and grantMS 
ifl^ lamented tham, in grant activities operating in FY86. 

e Goal evaluations do not examine program managasent procedures 
per se, but do try to determine whether intended major program 
inputs (see Figure 1, Column 2) occur at a levol that supports 
program objectives and the federal strategies thet ere pursued 
to attain objectives. 



Major ikmclusions 

The generally positive findings presented in the full report of the goal 
evaluation justify the conclusions that follw, but also indicate axvas that 
could profit from further examination in the next phase of the evaluation. 




StratMUs can »• laolMBanfd ThrouKfa Orant Activities 
To An g>ct«tt That Sumrf PcoKraa Obj»ctiv> 



IDS 



and 

Project Reaulta Suppor t ProKram Obiactives 

All projects in the study saa^le mre judged to b« ia^leawntinB (i) the 
federal strategies that were expected to be their primary emphasis and, in 
addition, (2) one or more of the strategies associated with other program 
objectives (and competition foci). 

Overall, the nature of quantitative and qualitative evidence of their 
activities and accomplishments, provided in the full report of the goal 
evaliaation. indicates a good fit with program objectives. (See below.) 

Many Project Results Are Well Documented 

Nearly 80% of the study san^le claimed to be achieving outcomes that 
pertain to the first program objective, "to produce more qualified personnel." 
They indicated that their supporting data included: numbers of individuals 
recruited, trained, and graduated (by level and specialty); number of program 
graduates who subsequently enter careers in i^ecial education in roles and 
areas for Which they were trained; number and nature of the training, technical 
assistance, and dissemination activities that grantees carried out; and the 
number and natura of the models and materials they developed. 

Over 30% of the study saoyle reported outcnaes and clainwd to have data 
to support the second program objective, "to in^rove the quality of personnel 
trained.** These data, however, are subjective and qualitative. Por example, 
evidence of nwdel quality, improved coopetance, and use of state-of-the-art 
practice in personnel preparation consisted mostly of subjective assessments of 
"experts.** project staffs (who may both design and implement the model during 
its developmental tryout), and participants' instructors or supervisors. 
Although soft, such data served the formative evaluation nee.'iS of these modal 
and program development projects very well. Moreover, as these thrae-year 
grant activities are presently focused, it may not be feasible to expect 
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grantees to obtain c ita that would rigorously support this federal program 
objective. 



More than 75% of the study sample reported outcra&es that constituted a 
wide variety of systra itqprovements which would support the third program 
objective, "to expand the capacity of the system for personnel development." 
Howevert much of their corroborating evidence probably will not be provided in 
final performance reports in a form that makes it feasible for federal program 
staff to extract eund aggregate. 

ProKram LoRic and Assumptions Are Valid 

In the type of analysis characteristic of a goal evaluation, judgments of 
the validity of pKVgram logic and assun^tions, and the plausibility of program 
objectives, are based on evidence of "congruence," rather than by testing 
cause-effect linkages. In theory, such an analysis may reveal that what 
projects in the field are actually attempting in their day-to-day operations 
is noi consistent with expectations at the federal program level. However, in 
the Personnel Preparation Program's case, (1) a close correspondence was found 
between expected and reported enchases on federal strategies through major 
kinds of grant activity, and (2) the results and corroborating data that 
grantees in the study saaq^le claim to have will support federal program 
objectives. 

In short, major incongruities with the logic model are apparent from 
what is actual ^ii^ atten^ted through the operating grant projects in the 
study saiq>le. 
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Recommendations 

The full report of the goal evaluation presents two types of recommenda- 
tionp. One set suggests actions that could be taken imnediately to address 
probln&s or information gaps the goal evaluation identified. A second set 
identifies '*«indidate topics that could be examined in the strategy evaluation 
phase of thw ^tudy. 
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APPENDIX B 

Personnel Preparation Program Strategy Evaluation 
Data Collection Protocol 
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Personal Preparation Program Strategy Evaluation 
Data Collection Protocol 
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Cover Page: General Descriptive Inforsuitlon for the Local Unit 
Section A. Process Model for a "Hire" (LBA) 
Section B. Data Inventory and Reporting (LBA) 
Section C. Perspectives and Suggestions (LBA and SEA) 
Section D. SEA Interview Guide (SBA) 



ROTB: The "respondent" to Itens In this Interview guide was 
the study team. Interviews were exploratory and 
unstructured. 

Questions that work group members proposed are In 
italics. 
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ID 1: 
AIR Rftvit.'imr: 



CwiraA Dgaeriotivft Information for the Local Unit 



Instructions to intarvimr: 



Pull the information for this cover sheet from the OBAch oore comprehensive 
infoK;»tion you develop fnm document reviews and interviews with state and 
local staffs. 

This cover sheet is for our internal ufe, and shmild not be construed as 
limit ins thm focus of the pilot study in any way. See attach«<d guides . 



e Agency Type 

LEA 

intermediate edi -.ational unit (includes cooperatives) 

other (Specify: > 

e Overall SIS Level (roufth averags) 

High Medium Low 

e Local 

Urban Sul^rbfim Rural 

e Per capita Hires 

liumber of hires 

ADA, ADM, enrollment, other (Specify: 



Expressed as a ratio 



Budget, Staffing, Inrollnent 

% Budget for special education teaching staff as a percentage 

of budget for total teaching staff 

$ , special ed. teachers; I , all teachers 

% special ed. teachers as a percentage of total teachers 

M special ed. teachers M total teachers 



X Special ed. enrollment as a percentage of total enrollment 
H special ed. enrollment M total enrolliwnt 
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Are you eutrently expeziencing ahottayes of special 
education personnel? 

teacher 9? 

AiiFinistrAtots? 

related services personneJ? 

Do you have a need in the district for doetoral-level 
personnel? 

adi^nistrators? 

resear^ters? 

teachers/ trainers? 

Do you think there are differences hettteen SEM and LEA data 
that reports needs for personnel? 



Hott exactlu do you define need for personnel? 



Haw stable is hiring in your district? 



i 
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jio ytHi Mr* la these areas: 

infaat? 

MJiaguol/Mcuicurai? 

ttansl tion? 

consulting ceacAers? (i.e., tp assist LRS inpleaentation? 

(DetBrJBlne iocai meting. J 



Do you currently collect data in a m&nner that would/ could 
ptOYl^ breakouts by these particular categories? 



e Are these data used In your hiring decisions? 



What are your personnel needs for m»^patir«*mina/LRS requirements? 
Do you have needs for additional training? 
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A. ProcMS iiodtl for a "Mir*** 



Um for: ISk interviews and interviews at intermediate 

educational units 

Protocol Question: What sequence of steps or events leads to "one hire**? 
Rationale: 

To grasp the coiqtlexitlas of msLt^ "hires'* as an estimate of 
personnel demand, we must understand the local process for 
fillins a vacancy. This entails knowing what steps lead to 
**one hire,** what situations cause a step to he shipped, idio 
makes what decisions at each step, what infonnation the 
decisioraaaker uses at each step, how and to whcm the decison- 
maker reports after making the decision, and the timing of 
decisions. 

Sources of Data: 

Key decisionmakers for special education personnel hiring, 
personnel policies, and individuals who are n»8t loiowledgeahle 
ahout special education personnel needs. Sxaoples: Director 
of Pupil Personnel, Director of Special Education, Budget 
Officer, Superintendent. 



Instructions to interviewer: 

There are 3 parts to this section of the interview guide: 

e Sequence and Bature of Events Laading to a ''Hire'* 
e Decisions, Data Bleomits, and Information Flow 
e Hypothetical Process Model 

Your task is to develop one (or n»re) generic models that fit the 
process at this site for hiring someone to fill a budgeted, unfilled 
vacancy. 

Cat the interviewee to think through the sequence , you might open 
the discussion this way: "How do you know when you need to hire 
more special education staff T I'm going to ask you to think of 
•hire' as 'filling a vacancy.' What steps are involved?" 

If several generic sequences are possible, document thea 
separately. If you have trouble getting the discussion off the 
ground, it may help the interviewee if xSli Sive an illustrative 
sequence. (See the Hypothetical Process Model on p. A-4.) 
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Hm 15 hiring hMdled for rslAted smiM oezacml? 



Hott m doclsloiis s»<ie to hire uncertified aad gaaer oencu 
petaoimel? 



Han are adtalnistracive decisions made on haw mami teachers 
wlJl be hired ia ami given near ? (E.g., "HeedT my he the 
aaae as previous yemr, but fettwr teachers my be hired due to 
budget f state appropriation, tax base, etc.) 



Interviewer : Use large oversize sheets to answer these questions. 



Sequence end Matuw. of Bwnta Leading to a "Hire" 

1. Identify and describe each steir^ or event. 

2. How Ions does each step taker 

3. What problems sdsht typically occur? 

4. What situations misht cause a step to be skipped? Rntail a 
different step? 

5. Having arrived at the last step in the process ("hire"), why would 
atmeoM WOT be hired at this point? 

6. If the process was any different over the last 5 years, ask why. 
(Ho need to write down an obsolete sequence, however.) 



Decisions. Data Blwnents. and Information Flow 

7. For each step, who is thts decision^ker? At what level? 

8. What information does he or she use to make the decision? 

Identify specific data elements now if this interviet^ 
knows them. Otherwise, do so in section B. 

9. How and to t^ma does the decisionmaker report after making ttm 
decision? 

Record under Contact Information on next page. 

10. If you don't know by now, ask if /how those with hiring authority 

link up to data. (In LBAs, personnel and data units may or may not 
interface much.) 



Documentation/ gvidence for Process Model(s) 

Oat copies of relevant forms or data summaries if this intervisMe has 
them. Otherwise, do so in section B. Hake sure you understand their 
purpose, terminology, content, and message. Attach and complete a 
Docuirontation Control Sheet to each doeunant you collect. (A supply of 
these sheets is in your folder.) 
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contact Infonofttion f or Procass lftMl«l(g) 

Get naama, titles, addmsea, and phone nuobera for decisionmakers and 
for persons who are responsible for relevant databases. List them below 
and cross-reference then to specific steps in particular process Bodel(s) 
you developed. 
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HTOothatical Pwaa Model 



It may twlp ttm interviowee understand what you are after if you offer a 
hypothetical sequence of steps leadins to '*one hire." This model is such 
an exao^le; however, it is probably more rational than the local process. 
You want reality : ea^hasize that to the intervictiee. 

For example, oecisions may be made independently, or in a different order. 
Perhaps all steps are linked to a single decisionmaker, are made at one 
level, or are made at aniltiple levels. Otimr scenarios are possible. For 
example, up to Step 3, the event could be '^Replace person (X) who left or 
retired." As for "data elements,** identify the ones that are actually 
used in the decision process you identify, because they are imbedded in 
what determines a "hire." 



Sequence and Nature of 
Bvents Lead inn to a Hirs 



Step 1. Specify the activity or 
service (A/S) to be 
provided by the hire. 

Step 2. Specify the percent of 
one FTB (Y) required 



Decisionmakers 



Building Principal 



Building Principal 



Data 
glfl^nts 



# of students 
multiplied by 
time per stu- 
dent 



Step 3. Specify credentials (C) 
needed to perform A/S 
(the activity or service 
in Step 1). 

Step 4. Get budget authority for 
hiring. 

Step 5. Find an available person 
(X) with appropriate 
credentials (C) who has 
y percent of time. 

Step 6. Assign person X (with 
("Hire") C credentials) to carry 
out activity or service 
A/S for y percent of his 
or her FTE. 



Director of Special 
Bducatlon 



District Superintendent 



Director of Personnel 



Director of Personnel 
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B. Data Xnvantory and iteportins 



Um for: Intarviem and intarvlfins at intermediate 

educational units 



Protocol Queationa; 

a Of tiioaa data elaamta tbat are uaed to datarwtna "hiraa.'* what daU 
auflwiaa ara available (for 3 to 5 years back, if poaalble}? 

Tbeaa data elanmta aay bava ba«i idaatif led in 
devaluing tba Procaaa Hodal(a) in Mctien A. 

a Hbat data suaHariaa are available for other quantifiable f actora tbat 
aitbt need to be teown and controlled for if *Tiirea- were to be uaed aa 
an eatiaata of peraonnel denand (tteed)T 

e Uhat are the reporting routinea for all the above data? 



Rationale : 

"Hirea** nay itself be a composite of several meaaures. To clarify the 
definition of "hires" as a measure of personnel demand (need) , our 
inquiry twist get beneath the label to identify these data elements. 

Moreover, if hires is to be a proxy for special education peraonnel need, 
it muat correlate with independent meaaures of special education 
staffing. We need to find out ham "hires" is related to these other 
measures . 

To be most useful to federal level policymakers, information on each 
variable muat be available and economical to retrieve through chaimels 
that the federal govenuront can access (e.g., SBAs). Policymakers want 
data that are accurate and reliable. For these reasona, it is Important 
to determine reporting routines for the data. 

Sourcea of Data: 

Persons most knowledgeable about data collection, reporting, interpreta- 
tion, and management and about special education personnel needs. 
Sxamplaa: Directors of Research and Svaluation, Special Bducation. Pupil 
Peraonnel. 
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Ziwtruetlona to intorviawr: 



m* Data Znvantory in this saetion of tho intervlsw suidt is divitod into 
7 data catOKorios: 

• Hiras 

• Qualifications of New Hires 

• Faculty Attrition 

• Vacancies 

• Enrollment and Staffing (includes teacher-pupil ratios) 

• Budget 

• Other 

The protocol in each section follows the same sequence, in which you 
determine: 

• what ^gregated (summary) data are available 
e exactly what the n»asuras are 

• the process for producing (reporting) the data 
and you: 

t obtain and annotate data suramaries 

• fill out a Documentation Control Sheet for each docunwnt 
or summary you collect 

Each of the 7 protocols is tw panes lona and boRins on a new 
pa<^e . CA supply of the Docuirantation control Sheets is in your 
folder.) 



e Do you keep track of the follouino ir^orioAtlon, and do you 
use it in making Airing decisions? 



Data C^Mon: Hirts 

1. tfhat MSr«t«t«« (BUflBsry) data ara availabia at tha L8A laval that 
ara uaad in apacial aducatlon personnal staffing dacisionsT Marie 
thaia with an HL.** 

B. H nawly hirad apacial education staff aa 8 parcentasa of 8 

employed , by catasory or handicapping condition 

b. S full-tlsa •qui.va-es.tu (FTBs) required and I FTBs hired, by 

category or han^.lci i^<:iiit|i condition 

_ c. Sourc J of hires (».); < out-of -district transfers, new 

graduates of IHBa in '.ste, out of state; continuing but newly 
qualified personnel) 

Aafc i If /how is the process different for these 
different types of hlresf 



Other (specify below): 

d. 

e. 

f . 



• What information do ^/ou breaJc out for "new hires"? 

type of certification? 

maer^ncy/teaporary status? 
other? 
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For each "X" in itan I: 



2. What exactly are the meaaures that have been used to produce these 
data? How calculated T 



3. What is the process for producing (reporting) the data suimnaryT 

• Who pr<Hluces it? 

• When (month)? 

• Level of aggregation (LBA? school? grade? etc.) 

• If /how data's accuracy checked 

• Effort required to produce (staff/tine on task) 

• To whom are the data reported? 



ERIC 



HOTS: Some of the ahove should be confirmed by SBA interview, e.g. , 
when and to whom data ax^ reported. 

4. Obtain documentat ion/evidmice . Get copies of relevant forms or data 
summaries (unless you already got them when you were developing the 
Process liodel in section A). Haka sure you understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentation Control Sheet to every 
document you collect. 

B-3b 
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Data CataKory ; Qualif leations of »ew Hiras 



1. Uhat as8rn«t«4 (miomary) data ara available at the lEh level 
that are used in special education pereonnel staffing 
decisionsT Mark these with an '*Z.'* 

a. V certified and ■ with leas than full certification, by 

category or handic^ping condition 



b. M qualified in one area but serving in another 

Other (specify below): 



d. 



e. 
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For each "X** in itaa 1: 



2. What exactly are the measures that have been used to produce 
these dataT How calculated ? 



3. What is the process for producing (reporting) the data summary? 

e Who produces it? 

e When (month)? 

• Level of aggregation (LSA? school? grade? etc.) 

e If /how data's accuracy checked 

e Bffort required to produce (staff/time on task) 

e To whom are the data reported? 



80TB: Some of the above should be confirmed by SEA interview, 
e.g., ^en and to whom data are reported. 



4. Obtain documentat ion/evidence . Get copies of relevant fonns or data 
summaries (unless you already got th«n whan you were developing the 
Process Kodel in section A). Make sure you understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentation Control Sheet to every 
document you collect. 
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Data CfttaKory ; Faculty Attrition 



1. What assr^atad (sunmary) data ara availabla at the LKA level that 
ara uaad in spacial education parsonnal staffing decisidnst Mark 
thaaa with an "X.** 

a. magnitude 

b. sources of attrition (e.g., retirwaent, out-of-district 

transfers « death, changing careers) 



Other (specify below): 



c. 



d. 



e. 



# Do you keep track of attrition for: 

1st year teac}»rs? 

Sth year teachers? 

lOth year teachers? 
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For each "X" in item 1: 

2. What exactly are the neasuree that have been used to produce these 
datat Hoif calculated? 



3. What is the process for producing (reporting) the data sunoaaryf 
e Who produces itT 

• When (month)? 



e Level of aggregation (LBA? school? gradef etc.) 



e If /how data's accuracy checked 



e Bffort required to produce (staff/time on task) 



e To whom are the data reported? 



liOTB: Son» of the above should be confirmed by SBA interview, 
e.g., \Amn and to whcHO data are reported. 



4. Obtain doct^tentation/ evidence . Get copies of relevsnt forms or data 
sunnaries (unless yMi already got then when you wre developing the 
Process Hodel in section A). Make sure you understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentation Control Sheet to every 
document you collect. 
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Data CatMtory ? Vacancies 



1. What aggragAtad (sussBary) data ara avaiXabXa at tlia tSA level 
that era uaad In special education parsonnel staffing 
decislonsr Nark these with an '*X.'* 

a. 5 positions budgeted and unfilled, by category or 

handicapping condition 



b. H positions recruited for, by category or handicapping 
condition 



c. Sources of vacancies (e.g., program expansion, loss of 
personnel) 



Other (specify below): 



d. 



e. 



• Do y<Hi think stAte- rmvorted cspd need/ vacancy figures seen 
accurate? 

f9%ere Is sobbs indication that states are underestimating 
need/ vacancy figures. J 



f . 
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For each "X" in item 1: 



2. What oxactly ar« the maaaMraa that have been used to produce 
these data? Hon calculated ? 



3. Uhat is the process for producing (reportinj) the data sunroryT 

a Vho produces it? 

e When (month)? 

• Level of assresation (LBA? school? grade? etc.) 

m If /how data's accuracy checked 

e Effort required to produce (staff /time on task) 

e To whom are the data reported? 



won: Soa» of the above should be confirmed by S&A interview, 
e.g., when and to whom data are reported. 

Obtain documentation/evidence . Get copies of relevant forms or data 
sumoarias (unless you already got them when you were developing the 
Process Model in section A) . Make sure you understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentat ion Control Sheet to every 
docuinent you collect. 
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Data caf Kory : ftirollawnt and Staffins (and teachar-pupil ratios) 

1. Uhat a8sr*8«ttd (suanary) data m availaMa at the LSA level 
that are used in special education personnel staffing 
decisions? Mark these with en 

a. unduplicated child count data, by handicapping condition 

(92-142) 

b. percentage of handicai'ped in total school population by 

type of handicapping condition 



c> H special education personnel ey^loyed, by area end FTB 
d. teacher^pupil ratios 
Other (specify below): 



e. 



f . 



• Is there a state guideline on mi nimum/ maximum teacher -pupil 
catios? On using aides? Can these ratios change? Why, and 
haw easily? 
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For each "X" in item 1: 



2. What exactly are the aeaaures that have been used to produce 
these data? How calculatedt 



3. What is the process for producing (reporting) the data sunmaryr 

e Who produces it? 

e When (month)? 

* I'OVol of aggregation (LBA? school? grade? etc.) 
e If /how data's accuracy checked 

• Bf fort required to produce (staff/time on task) 
e To whom are the data reported? 



HOTB: Some of the above should be confirmed by SBA interview, 
e.g. , whm and to whom data are reported. 

4. Obtain documentation/evidence . G»t copies of relevant forma or data 
summaries (unless ymi already got them when you were developing the 
Process Model in section A) . Make sure you understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentation Control Sheet to every 
document you collect. 
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Dmta CataKOry: Budget 

1. Mwt 88Si:«8«t«d (suaaury) data are availabla at the L8A level 
that are used in special education personnel staffing 
decisioner Iterk these with an 

a. for special education teachers 

b. per handicappml student 

c. funding formula 

Other (specify below): 



d. 
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For sask 

2. wh«t •XACtXy mrm the i»ftaur«s that have been us«d to produce 
these data? How calculated ? 



3, What is the process for producing (reportins) the data suamaryf 
e Who produces itT 



e When (month)? 



e Level of agsregation (LBAT school? grade? etc . ) 



e If /how data's accuracy checked 



e Effort required to produce (staff/time on task) 



e To whom are the data reported? 



MOTB: S«ae of the above should be confirmed by SBA interview, 
e.g., wiMn and to whom data are reported. 

Obtain docuaentation/evid«ice . Get copies of relevant forms or data 
sunnarias (unless you already got them whm you were teveloping t)M 
Process Model in section A). Hake sure you understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentation Control Sheet to every 
docwoent you collect. 



B-8b 

175 

ERIC 



Dfcfca CAf Rory ; Ottwr (Spacify cat«sory hmrm) 



1. ybat assmAtad (suanary} data are available at the LEk level 
that are uaed in special education personnel staffing 
dec is ions r Mark these with an "X." 



b. 



c. 



d. 
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For each "X** in iten 1: 



2. What exactly ara the maasurea that have been used to produce 
these data? How calculated ? 



3. What is the process for produclns (reporting) the data sumraaryf 

* Who produces it? 

e When (month)? 

e Level of aggregation (LBA? school? grade? etc . ) 

e If /how data's accuracy checked 

e gffort required to pn^uce (staff/tiB» on task) 

• To whom are the data reported? 
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KOTB: Some of the above should be confirmed by SBA interview, 
e.g., when and to whom data are reported. 

4. Obtain documentat ion/evidence . Get copies of relevant forms or data 
sunaiaries (unless you already got then when you were developing the 
Process Model in section A). Make sure "ou understand their 
purpose, terminology, content, and message. 

e Attach and complete a Documentat ion Control Sheet to every 
document you collect. 
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DoamoTATZOV oomsiL sbbt 

iMt ructions to iatorvimor: 

Got copies of rolevant forms or data summaries. Make sure you 
understand their purpose » terminology, content, and messasa. 

Attach one of these (completed) control sheets to every document, 
~orm, or suasnry you collect. 

Who save you this document (in case you need help t#ith it later)? 
Hame/Title: Phone: 
Hailing address: 

Bibliographic Reference (APA Format as per Publication Manual): 



What is the data category? 

Hires Budget 

Qualifications of Mew Hires Other (8p«^.ify below): 

Faculty Attrition 

Vacancies 

Bnrollment and Staffing 

(incl. teacher-pupil ratio) 



Which data elements or measures in this report are most pertinent to the 
above category? 



For what years did you obtain these data? 



Whac breakdowns are provided by the data? 

by type of personnel 

by handicapping condition 

by certification area 

other (specify below): 
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C. P«rgp«ctivM and SugsMtions 

ISA aod SBA Interviews 



Protoeol Questions i 

e Utamt conditions affect LEA hiring in ijqportaat my, but ere not 
routinely collected ee quentif ieble dets for use in statistical 
analyses of personnel deoMadt 

e What difficulties are likely to be encountered if fuaatitative data 
(of the types identified in section B) were required to iaplemnt a 
federal strategy for targe^ins critical needs? How fldglit these 
difficulties he ^dressedt 



Rationale: 

Bureaucratic and contextual conditions that may be awkirard to 
quantify can confound "hires" as a valid and reliable estinate of 
personnel drauuid (need). Bxanqples are: geographic location; 
recruitiMnt activities; federal and state policies that affect the 
ease or difficulty of finding qualified personnel; coiqpetitiveness 
of salaries for new hires; econrailc conditions; population mov«nent 
into or out of an area, and so forth, it Is la^rtant to articulate 
such "disposing conditions" because they suggest caveats for 
Interpreting quantitative estimates of personnel donand. 

Moreover, as a practical matter, policyn^cers who would use data on 
"hires" as an estimate of personnel donand oaist anticipate probl«BS 
that are likely to be encountered in obtaining and using available 
data. The channel for data on personnel demand will be the SEA, who 
in turn must look to LSA sources. Therefore, it is important to get 
SBA and LEA perspectives on What it will take to obtain good data 
and to build an adequate data nyatma. 

Sources of Iteta: Same as for sections A, B, and 0. 



Instructions to interviewer: 

Look for opportt ;lties to explore these topics while you and the 
lntervim#ee are discussing the points in section A (Process Model) 
and section B (Data Inventory and Reporting). 

If you run out of time, get the interviewee's agreement to a 
follow-up phone interview on those topics that the interviewee is 
best qualified to address. 
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yhat obgarvatiof if^, f»iBBf^tiong wnd r«c<»a«id>tion« domm this 
intgrvlawM offgr regarding: 

• affactiva stratagies for obtainii^ reliable data (of the 
types in section B) froa LBAsT from SBAst 



potential problems and possible solutions in moving toward a 
central (national) data system that might require such dataf 



What is the recruitment situation? Specify: 

e How and Who recruits new hires to meet personnel needs? 
what strategies are in place? 



What factors that have helped or hindered efforts to recruit 
new hires? (HOTS: May overlap with perspectives on topics 
in the next item.) 



• jure new teacher incentives offered? 



Is an earlu retirement option available to open up new 
positions? 
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Idantify idiat this Interviewee i^rceives ere the isost eimlf leant 
if^fluencee on the personnel demand situation in the locale (or 
state), and why . Bxamples could include: 

definitions used for handicapping conditions 

studmt eligibility criteria for services 

multi-categorical prograaming 

cooperative arrangeiamts 

extracting for services 

certification practices 

canpetltiveness oi salaries for new hires 

federal or state policies 

« 

changins priorities 

economic conditions in locale (or state) 

seographic factors 

population (Bov^nent into/out of area 

other (specify) 



lAiat laq>ortant future trends does this interviewee anticipate » and 
whyT Focus on trends that are mont pertinent to: 

e the processes that pertain to "hires" (section A) 



e categories of quantitative data that you obtained (section B) 



In this interviewee's opinion, are ttwra other loqportanc considera- 
tions that the federal govemnmit stould t^ke into accmint in esti- 
mating and targeting critical personnel needs in special educaticmT 
What are they* and Why are they criticalT 
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D. SIA ZntttrviMi Quid* 



SEA InUrviaMS will pfc»4» lnt«rvi««s mt LBAa (or Intarmdiata units) . 
PiarpoM: 

Although tha pilot study's focus is tha local laval, a major 8«taway 
through which Information on critical parsonnal naads flows to tha fadaral 
govamaant is tha SBA. Tha quality and utility of information that SSAs 
can provida is af factad by standard procaduras that UAs in tha stata must 
follow to produca local data. Tharafora. ona purposa of intarviawing SBA 
staff is to laam what thaaa atandard procaduras or raquiraswnts ara. 

A sacond purposa for SBA intarviaws is to gat a sansa of procaduras that 
ara standard or raqulrod for filling local spacial aducation vacaneias. 

A third purposa is to obtain data linkad to individual LBAs that can ba 
usad for tha statistical analysas in tha pilot stt^y. 

Sourcas of Data: 

Staff Who ara rasponsibla for spacial aducation parsonnal policy or for 
data collaction. analysis, reporting, and managaoant, and whosa axpartisa 
anablas tham to provida practical insights on What it takaa to obtain good 
data iroa LffAs and to build a good data system, and on factors that affect 
hiring, including bureaucratic and contextual factors. 



1. What are standard procedures or requirements of LBAs (or inter- 
mediate units) for hiring special education personnel to fill 
vacancies? 

tfOTB: This will set our expectations for how Lg& 
interviewees may respond to topics in the interview guide 
for section 4 (Process Model). 

2. What are standard procedures or requirements of LBAs (or inter- 
mediate units) use for providing data to the state? 

IR3TB: This will set our expectations for how ytt inter- 
viewees may respond to topics in section i regarding data 
and reporting on hires, their qualifications, faculty 
attrition, vacaneias, enrollment and staffing, budget, etc. 



3. Identify and describe available data ts)es that the SEA uses for 
identifying special education personnel dMsand (need) and that 
link information to individual LBAs. For each tape, ask: 
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a. By what "nama" would a raquaator ask for tha tapaf 

b. What aort of infomation doaa tha tapa provida? 
Whafc spacif ic data al«8anti doaa it containt 

NOTB: Safer to tha Data Xnvantory In section B if you 
cannot obtain a degeriotion and list froa the SBA. 

c. On what basis will the SEA maka the tapa availablet 
If applicable, indicate the cost of the tapa. 

d. What are reporting routines? Specifically: 

(1) Bv Whom/ to whoa are the data reported? 

(2) When (fiionth}? 

(3) Level of assregAtion (statewideT LBAT trmAmJ other?) 

(4) If /how is data's accuracy cheeked? 



4 tiha saa» vein, can the SBA provide data tapes for other 

Anfonnation on LSAs that would allow us to determine differences and 
similarities between the LSAs in the pilot study sample and other 
LBAs in the state? If yes, cover a, b, c as above, skipping the 
"Note** under b. 



5. Obtain documentat ion/evidence . Get copies of relevsnt forms, data 
sumaaries, and reports that accon^any tables with explanatory 
narrative. Make sure you understand their purpose, terminology, 
content, and message. 

e Attach and complete a Docuawntation Cont rol Sheet to ^^Stk 
document you collect. A sample is attached as tha f ipal 
page in section B i xerox several copies of it before 
visiting the SEA. 



6. Explore applicable topics from section C 's interview guide 
(Perspectives and Suggestions) . 



Mi»r SSA Otimatloia 

• Arm Omn dXttmncas hmttmen SKA and LSA d^ta that reporta 
mmda tor pmraonml? 
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• Ho^ wmll do LBAa rmport continuing nemda/unfiUmd poaitiont 
to scats? Can a bettsr ^oft b€ ^nt to ^t thia informtion? 
(Pmt: 1982 Pad. roporting rmquirmant) 
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APPENDIX C 
Pilot Study Interviewees 
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Pilot study Interviewaes 
Study Saetplei SBAs (H»2). LBAs (HalO) 



North Carolina State Department of Public Instruction 
A. Craig Phillips, State Superintendent 



SEA Interviewees 
Fred Baars 
Donald E. Ferguson 
Richard Clontz 
Martha Kincheloe 
M. Bngin Konanc 



LKA Interviewees 

James HcXethan 
Cumberland County Schools 
Payetteville, HC 

Joanne Clark 

Greensboro Public Schools 
GrecNtisboro, HC 

Buddy ColttBsn 

Greensboro Public Schools 

Greensboro, WC 

Sandra Mehalick 
Guilford County Schools 
Greensboro, UC 

Jean Averette 

Pitt County Schools 

Greenville, 8C 

Christina S. Drye 
Pitt Coimty Schools 
Greenville, BC 

Sylvia Home 

Onsl<»« County Schools 

Jacksonville, MC 
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• Wisconsin State DepartiOient of Public Instruction 
Hertert J. Grower, State Superintendent 



SEA Interviewees 



LEk Interviewes 



Thomas Stockton 



Laurie Derse 



Sharon Grant 

Milwaukee Public Schools 
Hilwaukee, UI 



Ann Kellogg 



Stephanie Petska 



Helen H. Collins 
Milwaukee Public Schools 
Milwaukee, UI 



James M. Wall 



Dorothy Placide 



David Damgaard 
Wausau School District 
Uausau, UI 



Ken Hobbs 

D.C. Everest Area School District 
Schofield, WI 

Laurence Baker 

D.C. Bverast Area School District 
schofield, WI 

Herbert F. Kalinosky 
Southirestem Wisconsin Community 

School District 
Hazel Green, WI 

Robert Malsch 

West Bend School District 

West Bend, WI 

Peter J. Haimetti 

West Bend School District 

West Bend, WI 

Sandra Bemdt 
CBSA #06 
Oshkosh, WI 

John Kotek 
CBSA #06 
Oshkosh, WI 

Ron 01 le 
CBSA #03 
Fennimore, WI 
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